Agent Friendly Code
← back to leaderboard

pytest-dev/pytestGitHub

https://github.com/pytest-dev/pytest
Stars:
13.8k
Default branch:
main
Last scored:
5h ago
Overall

Strengths

  • CI configuration
  • Dependency manifest
  • License file
  • Linter / formatter config
  • Pre-commit / git hooks

Gaps

  • AGENTS.md / CLAUDE.md
  • CONTRIBUTING guide
  • Reproducible dev env

Suggestions to improve for a specific model

  1. 1
    AGENTS.md / CLAUDE.md
    Add an AGENTS.md covering project goals, layout, setup commands, and conventions. Aim for 800+ chars of real guidance (not boilerplate).
    +8.5 pts
  2. 2
    Reproducible dev env
    Add a Makefile or devcontainer or Dockerfile so the agent can set up the project in one command.
    +7.0 pts
  3. 3
    CONTRIBUTING guide
    Add CONTRIBUTING.md describing branch naming, commit style, test commands, and the PR process.
    +4.2 pts

Per-model scores

Claude Code
Weights AGENTS.md and tests heavily — Claude Code leans on an instructions file and a fast feedback loop.
64.5
Cursor
Weights type config and a detailed README highly — Cursor's inline edits benefit from static types and skim-readable docs.
76.2
Devin
Weights CI and reproducible envs highly — Devin runs in a sandboxed VM and needs end-to-end automation.
68.9
GPT-5 Codex
Balanced profile as a reference point.
70.7

Signal breakdown

AGENTS.md / CLAUDE.md· 0% pass
No agent instructions file found
CI configuration· 100% pass
6 GitHub Actions workflow(s)
.github/workflows
CONTRIBUTING guide· 0% pass
No CONTRIBUTING file
Dependency manifest· 100% pass
Manifest present
pyproject.toml
Reproducible dev env· 0% pass
No Makefile / devcontainer / Docker / equivalent found
License file· 100% pass
License present
LICENSE
Linter / formatter config· 100% pass
Configured in pyproject.toml
pyproject.toml
Pre-commit / git hooks· 100% pass
Hook framework configured
.pre-commit-config.yaml
README· 100% pass
README detailed (5474 chars)
README.rst
Manageable size· 80% pass
615 files
Test suite· 70% pass
Test files detected (testing/_py/test_local.py)
testing/_py/test_local.py
Type configuration· 100% pass
Configured in pyproject.toml
pyproject.toml