docs(parity): full-surface audit — backend gaps + web-UI feature gaps#2225
Merged
Conversation
…ion gaps, perf & leaks Audit every services/* handler/backend (popular services first, then the long tail) and record open findings in parity.md across four buckets: missing/unimplemented SDK operations, incorrect AWS emulation, performance hotspots, and resource leaks, each cited to file:line. https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8
Audit every ui/src/routes/<service>/+page.svelte (popular services first, then the long tail). Record missing-page services and per-service missing UI features (CRUD actions, sub-resource tabs, detail drill-downs, action consoles, live tail, JSON editors), cited to each page. https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8
agbishop
changed the title
Collaborator
Author
📊 Code Coverage Report
Tip This project maintains a minimum coverage threshold of 85%. Maintain or improve coverage on new code to ensure long-term stability. Last updated: Wed, 10 Jun 2026 22:02:51 GMT |
Inventory integration-test and Terraform-test coverage gaps (exact service lists computed from the test tree), deep-dive the still-thin untested services (canned-inference vs empty-stub vs missing sub-resource ops), and add an 'eclipsing LocalStack' priority list. Only parity.md changed. https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8
… & deep op-accuracy Pass 3: CloudFormation resource-type coverage (~111 supported + curated missing-types list incl. custom resources/macros), platform-feature parity vs LocalStack (health/reset present; SigV4 validation, multi-account/region isolation, CBOR, TLS, persistence API missing), cross-service event wiring (largely implemented — recorded as a strength + true partials), deep op-level accuracy in S3/DynamoDB/SQS/Lambda/EC2, and concrete int/terraform test targets. Only parity.md changed. https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8
Pass 4: a discrete file:line backlog for a downstream fixing agent, found via op-level fidelity hunts across popular + long-tail services — pagination cursor off-by-one clusters (ECR, QuickSight, DataBrew, MQ, AutoScaling, ELBv2), MaxResults/NextToken gaps (Cognito, CodePipeline, Athena, IoT), bounds validation (KMS/IAM/SSM/SecretsManager/CFN), SDK-waiter blockers (Lambda CreateFunction state, Glue StopCrawler), and response-shape fidelity (SNS XML tag case, SQS/Cognito JSON keys, DynamoDB DescribeTable/ Scan, EC2 DescribeInstanceStatus, RDS). Rejected the omitzero false-positive (go 1.26 supports it). Only parity.md changed. https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8
Pass 5: ~70 more discrete file:line items for the downstream fixing agent across the services not combed in pass 4 — pagination off-by-one (AccessAnalyzer, Detective, RolesAnywhere broken token, DocDB/Neptune bounds), MaxResults/NextToken gaps (ApplicationAutoScaling, SSOAdmin x19, Macie2, MediaConvert, MediaPackage, Polly, Forecast, CodeStar/CodeConnections, Account, Route53Resolver, X-Ray), bounds/required-field validation, response shapes (DDB Streams, APIGW-Management GoneException, RDS-Data, DAX, Scheduler), error codes (OpsWorks/Support/S3Tables), and a Forecast describe() stale-status waiter blocker. Only parity.md changed. https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8
Pass 6 goes deep into the biggest handlers' sub-operations. Highest-value: Cognito auth correctness (token_use not validated -> ID token accepted as access; auth_time lost on refresh; ConfirmSignUp empty-code; identity-pool empty-Logins auth bypass) and CloudFormation fidelity (error-code mapping, unsupported-resource-type silently succeeds, Fn::GetAtt/Sub/ImportValue silent failures, capabilities case, missing DescribeStacks fields). Plus EC2 sub-resource ops (ClientVPN/ENI/NACL/snapshots), S3 multipart serialization, IAM GetGroup pagination, DynamoDB ItemCollectionKey, and remaining services (VerifiedPermissions key case, CloudControl status, Timestream/SageMakerRuntime/MediaStore). Only parity.md changed. https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Deep-dive read-only audit recorded in
parity.md— the working doc for eclipsing LocalStack's coverage. Onlyparity.mdis modified (now ~800 lines); no code changed. Every finding is an open candidate for follow-up PRs, cited tofile:line/ page / test path.Part 1 — Backend parity audit (every
services/*handler/backend)Popular services first, then the full long tail (~149 services), grouped into:
nil).Part 2 — Web-UI feature-gap audit (every
ui/src/routes/*page)Part 3 — Test-coverage & remaining-functionality audit (new)
test/integration/(202 tests today), ranked by value.test/terraform/fixture; recommends thesuccess+import+driftpattern since Terraform validation closes the most latent shape/waiter gaps per unit of effort.file:line.Each part closes with a Notes on confidence subsection flagging single-read findings to re-verify (e.g. AppStream/WorkSpaces need a precise handler↔backend op diff before their sub-resource gaps are treated as confirmed).
Notes
test/integration+test/terraformtrees.https://claude.ai/code/session_01WEREW2KfW1qEotUhUMovL8