Skip to content

Use more array programming style to improve firesquid speed #78

Open
@DylanVerstraete

Description

@DylanVerstraete

For some object we already use "array programming" meaning we collect all creates/updates inside a batch of blocks and save to the database later.

For farms, nodes, contracts, we still save one by one due to relations they have. In a future version, we should convert this to array programming style.

For example, you can read block by block and save entities to the db inbetween
or with batch processing you can: read X amount of blocks, save entities to be saved in memory and save to the DB whenever you processed the X amount of blocks => higher performance

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    No status

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions