← back to leaderboard

microsoft/vscodeGitHub

https://github.com/microsoft/vscode
Stars:
184.2k
Default branch:
main
Last scored:
5h ago
Overall

Strengths

  • CI configuration
  • CONTRIBUTING guide
  • Dependency manifest
  • License file
  • Linter / formatter config

Gaps

  • Pre-commit / git hooks
  • Type configuration

Suggestions to improve for a specific model

  1. 1
    Type configuration
    Add a type config (tsconfig.json for JS/TS, mypy.ini or pyrightconfig.json for Python). Rust/Go are typed by default.
    +7.9 pts
  2. 2
    Pre-commit / git hooks
    Set up pre-commit (.pre-commit-config.yaml), husky, or lefthook to run format+lint on every commit.
    +5.3 pts
  3. 3
    Manageable size
    If possible, split into smaller modules or carve out a focused entry path. Document where to start in AGENTS.md.
    +5.3 pts

Per-model scores

Claude Code
Weights AGENTS.md and tests heavily — Claude Code leans on an instructions file and a fast feedback loop.
75.4
Cursor
Weights type config and a detailed README highly — Cursor's inline edits benefit from static types and skim-readable docs.
73.4
Devin
Weights CI and reproducible envs highly — Devin runs in a sandboxed VM and needs end-to-end automation.
76.3
GPT-5 Codex
Balanced profile as a reference point.
74.7

Signal breakdown

AGENTS.md / CLAUDE.md· 80% pass
File exists (270 chars)
AGENTS.md
CI configuration· 100% pass
16 GitHub Actions workflow(s)
.github/workflows
CONTRIBUTING guide· 100% pass
Guide present
CONTRIBUTING.md
Dependency manifest· 100% pass
Manifest present
package.json
Reproducible dev env· 70% pass
Has .devcontainer/devcontainer.json
.devcontainer/devcontainer.json
License file· 100% pass
License present
LICENSE.txt
Linter / formatter config· 100% pass
Config detected
eslint.config.js
Pre-commit / git hooks· 0% pass
No pre-commit / husky / lefthook found
README· 100% pass
README detailed (6855 chars)
README.md
Manageable size· 20% pass
10001+ files — very large
Test suite· 100% pass
Found /test
test
Type configuration· 0% pass
No type config found