Home · Business · IT, Data & Security · Software development

PARTLY

As of 13 August 2026, AI can only partly scan your code for security flaws.

This still needs a person who signs their name to it.

Can you do it?

5 minutesto a draft.

1 hourto something you’d act on.

Cost, all in£0

Skill neededpower-user

Who has to check ita colleague

What the alternative costsNo human security-review price is provided in the supplied tool data.

If this goes wrong: you accept a plausible but incomplete review, leave a vulnerability in production and discover it after data or systems have been affected.

What to actually do

  1. Hand it to a person

    The route this page recommends

    A person who owns the outcome does this end to end, worth it when the failure is dear.

  2. Use a tool built for this

    Second choice
  3. Do it yourself

    The distant third

    A chat interface, power-user skill, and roughly 1 hour until you can act on the result.

    How to actually do it

    1. Open the repository in your code editor and remove secrets, access tokens, private keys, passwords and personal data before sharing any files with an AI tool.
    2. Gather the relevant source files, dependency and lock files, authentication and authorisation code, configuration, tests, deployment details and a short description of the data the application handles.
    3. Paste the gathered material into ChatGPT, Claude or Gemini using the prompt, keeping each file clearly labelled and stating what was omitted.
    4. Ask the model to produce separate findings for confirmed-looking issues, plausible issues and false-positive risks, with file locations, attack paths, remediation and independent checks.
    5. Run the suggested tests and a reputable static or dependency security scanner against the repository, then compare its results with the AI findings.
    6. Ask a developer or security-aware colleague to reproduce each material finding, inspect the proposed fix and check that the fix does not remove a required security control.
    7. Apply approved fixes in a branch, rerun the tests and scanners, and record unresolved findings and the limits of the review before release.

    Prompt

    Act as a security-focused code reviewer, not as the final authority. Review the code and project information below for security flaws. Do not claim the code is secure and do not invent files, dependencies, runtime behaviour or test results. Do not include or reproduce secrets, access tokens, private keys, passwords or personal data; tell me to remove them before sharing.
    
    Context:
    - Application type: [web app, API, mobile app, service or other]
    - Language and framework: [details]
    - Deployment environment: [details]
    - Authentication and authorisation model: [details]
    - Data handled: [details]
    - Threat model or security requirements: [details]
    - Relevant dependency and lock files: [paste or attach]
    
    Repository files:
    [paste or attach the relevant source files, configuration files and tests]
    
    For each suspected issue, provide:
    1. Severity with a short reason, without pretending the severity is certain.
    2. The exact file and line or code section involved.
    3. The security property at risk and a plain-English explanation.
    4. A realistic attack path and the assumptions it depends on.
    5. A minimal remediation proposal, preserving existing behaviour where possible.
    6. A test or independent check that a developer can run to confirm the issue and the fix.
    7. Any missing context that prevents a reliable conclusion.
    
    Separate confirmed-looking issues, plausible issues and false-positive risks. Check for injection, broken access control, authentication and session weaknesses, insecure secrets handling, unsafe deserialisation, path and file handling, cryptographic misuse, SSRF, XSS, CSRF, sensitive-data exposure, insecure dependencies and dangerous configuration. Finish with a list of areas you could not assess from the supplied material. Never recommend disabling security controls merely to make tests pass.

    Open it prefilled in ChatGPT or Claude, or copy it into Gemini, which takes no prefill link.

What it gets wrong

  • AI cannot observe vulnerabilities caused by the live infrastructure, deployment permissions, network layout or runtime configuration unless you provide and correctly describe them.
  • AI cannot prove that a codebase has no security flaws because its review depends on the files and context you supplied.
  • AI cannot reliably distinguish an exploitable issue from a harmless pattern when the threat model or surrounding code is missing.
  • AI cannot take responsibility for releasing the system or decide what level of residual risk your organisation should accept.
  • AI cannot replace independent testing by a security-aware developer or specialist for systems handling sensitive data.

What caps this at PARTLY: verification cost, judgement under ambiguity and stakes of error.

How we scored this

Five axes, each scored nought to two by hand: ten means AI carries the task cleanly, and the thresholds that turn a total into YES, PARTLY or NO are published in the methodology. Each axis name links to its definition.

AxisScore (0–2)
Output2
Inputs1
Verification1
Liability1
Effort delta2
Total7 / 10

FAQ

Can ChatGPT find security vulnerabilities in my code?
It can find plausible vulnerabilities and explain possible fixes when you provide enough code and context. It cannot prove that the code is secure, and its findings need reproduction with tests or security tools.
Is it safe to paste my code into an AI tool?
Remove secrets, access tokens, private keys, passwords, personal data and confidential business information before sharing code. Check your organisation's policy and the tool's data handling terms, and use an approved private setup where required.
Can AI replace a penetration test?
No. AI reviews supplied material, while a penetration test examines how the running system can actually be attacked and may find configuration and access-control problems outside the code. Use AI as an earlier review layer, not as evidence that the system is safe.
Should I fix every security issue AI finds?
No. Reproduce each material finding, check its file location and assumptions, and assess it against your threat model before changing production code. A security-aware developer or specialist should decide how to handle issues with serious consequences.

Nearby answers

Assessed by gpt-5.6-luna (gpt-5.6-luna) on 2026-08-13, second-checked by an independent model. Wrong somewhere? Email [email protected] and it gets re-checked.

The newsletter

AI news, new answers and product picks, straight to your inbox.