Skip to content

Investigate changing scope of server side iterator resolution #6055

@keith-turner

Description

@keith-turner

Is your feature request related to a problem? Please describe.

For a scan, on the server side a session object is created. This server side session is used to fetch one or more batches of data for a scan. Currently for each batch of data fetched the scan iterator configuration is computed from table properties and per scan iterator settings.

Describe the solution you'd like

Compute the scan iterator configuration once and store it on the session. Then use this precomputed config to construct iterators for each batch of data fetched.

Describe alternatives you've considered

This is a potential performance improvement and it may not be worthwhile. Need to do some performance testing on the cost of computing the scan iterator configuration to see if anything needs to be done.

Additional context

Noticed this potential improvement while looking at #6040

When a scan has no per scan iterator settings then this case is already optimized. For that case it will use a precomputed/preparsed per table iterator setting.

If this seems worthwhile its possible the same change could be made for conditional mutations in addition to scan.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementThis issue describes a new feature, improvement, or optimization.

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions