Skip to content

Add SIMD-Optimized Lexer for Performance Improvements #475

@malik672

Description

@malik672

Describe the feature

The current Solar lexer processes characters one-by-one with branching logic for character classification. We should be able to use SIMD operation to process large files in batches something like a mapping of characters to characters at scale batching but for characters

Metadata

Metadata

Assignees

No one assigned

    Labels

    A-parserArea: parsing source code to an ASTC-perfCategory: an issue highlighting optimization opportunities or PRs implementing such

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions