Skip to content

Add tree-sitter dependencies for Python parser - #24

Open
avshar15 wants to merge 2 commits into
google:mainfrom
awe-srush:feat/python-parser-deps
Open

avshar15 wants to merge 2 commits into
google:mainfrom
awe-srush:feat/python-parser-deps

Conversation

@avshar15

Copy link
Copy Markdown
Contributor

Summary

Adds tree-sitter and tree-sitter-python to Vanir's requirements.txt to enable the Python language parser.


Objective

The PythonParser implementation depends on two pip packages:

  • tree-sitter — core tree-sitter Python bindings
  • tree-sitter-python — compiled Python grammar for tree-sitter

Both packages are guarded with python_version>='3.10' so they are never installed on Python 3.9, where PythonParser is intentionally unavailable and .py files are silently skipped.


Changes

requirements/requirements.txt

Two new entries added at the bottom:

# tree-sitter and the Python grammar require Python >= 3.10.
# On Python 3.9, the PythonParser is unavailable and .py files are skipped.
tree-sitter>=0.21.0; python_version>='3.10'
tree-sitter-python>=0.21.0; python_version>='3.10'

Note for maintainers

Lock files (requirements_lock_3.10.txt through requirements_lock_3.13.txt) need to be regenerated after merge using:

bazel run //requirements:requirements_3.10.update
bazel run //requirements:requirements_3.11.update
bazel run //requirements:requirements_3.12.update
bazel run //requirements:requirements_3.13.update

Dependencies

This PR is independent and can be merged in any order alongside:

  • feat/tree-sitter-integration
  • feat/python-parser-build
  • bug/fix-subclass-discovery

Must be merged before feat/python-parser.

@varungoyal-ittiam

Copy link
Copy Markdown

Hi! To help us coordinate the testing and import of the Tree-sitter integration, we are tracking the consolidation of these changes in #21.

Please see this comment on PR #21 for details on how we plan to merge these PRs and preserve author attribution. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants