Sunset ATS

[Swatinem]

ATS has not provided the value that it set out to do, there is barely anyone using it, and its internal implementation is bad for performance, and blocking further improvements.

In particular, I would like to clean up all the labels and datapoints related code from the Report classes, which should simplify things and improve performance, as well as open up more opportunities down the road, in particular make any kind of rewrite it in Rust a lot simpler.

Stop using it ourselves

• Remove ATS-related configuration codecov-api#1166
• Remove ATS-related configuration shared#518
• Remove ATS-related configuration codecov-cli#644
• Remove ATS-related workflow gha-workflows#43

Clearly deprecate the feature

• Stop advertising it and the related commands / flags within codecov-cli
• Mark the feature as clearly deprecated in the docs
• Mark the github action https://github.com/codecov/codecov-ats as deprecated
• Reach out to the existing users (if there are any) about the deprecation
• A list of owner/repo using this feature is here: https://metabase.codecov.dev/question/273-labelanalysis-users

Implementation

• Hide and mark ATS-related commands as deprecated codecov-cli#662
• Make label-analysis and static-analysis noops codecov-cli#663
• Remove tree-sitter and associated build infrastructure codecov-cli#664
• Turn labelanalysis and staticanalysis views into noops codecov-api#1233
• Remove ATS-related label/staticanalysis tasks worker#1165

Profit

• Remove all label-analysis / ats related endpoints and code from api
• Remove all label-analysis / ats related tasks and code from worker
• Remove all label-analysis / ats related commands and code from cli
• Remove labels related code from the Report classes, the ReportBuilder, as well as the serialized format
• Possibly remove the EditableReport class completely, as I believe it primarily exists to deal with labels?¿?
• 🎉 profit 🎉

[Swatinem]

One question would be whether we could already start removing some of the backend code before waiting for a grace period to allow the few remaining users to move off of this feature.

In that way, we would just return a "good default", however that would look like, instead of computing the actual precise results.

[Swatinem]

I took a look at the existing (open source) repos using ATS, with the following outcome:

Two repos are using the codecov-ats action:

• https://github.com/Johnserf-Seed/f2/blob/447f145736cd35559da4fe4d0d9b788a1f7ac8c4/.github/workflows/Codecov.yml#L35-L36
• https://github.com/Jeffrey-Lim/onboarding-epoch-v/blob/53d962600c6007209642952799032ef81d3c193a/.github/workflows/unit-tests.yaml#L20-L24

For another open source repo that had a quite sophisticated manual setup, I opened a PR to remove usage of ATS:

codegen-sh/codegen#887

[Swatinem]

More PRs for the existing open source users:

• Remove usage of codecov ATS Jeffrey-Lim/onboarding-epoch-v#36
• Remove usage of codecov ATS Johnserf-Seed/f2#299

[Swatinem]

this is done now, and more work to clean up the Report code can start, related to removing the labels code.

[uartie]

Darn. I just came across this ATS feature in search and was looking forward to using it. Any chance the ATS code is open source?

[Swatinem]

The code is open source in the sense that you can find it in git history. But we have already removed it from the deployed and also self-hosted releases.