Skip to content

Final Integration and Release of Enhanced Visualization Features #136

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 114 commits into
base: develop
Choose a base branch
from

Conversation

codegen-sh[bot]
Copy link

@codegen-sh codegen-sh bot commented May 17, 2025

Overview

This PR integrates and finalizes the enhanced visualization features for the Codegen repository. The enhancements include:

  1. Inheritance Hierarchy Visualization: Visualize class inheritance hierarchies
  2. Call Graph Visualization: Visualize function call relationships
  3. Dependency Graph Visualization: Visualize symbol dependencies
  4. Module Dependency Visualization: Visualize module/file dependencies
  5. Interactive Selection UI: Support for selecting and viewing related code elements

Changes

  • Enhanced VizNode class with additional properties for visualization
  • Added new graph types to GraphType enum
  • Implemented utility functions for creating different types of visualizations
  • Added visualization methods to VisualizationManager
  • Created comprehensive documentation for the enhanced visualization features
  • Added example script demonstrating the enhanced visualization features
  • Added tests for the visualization features

Testing

  • Added unit tests for the visualization features
  • Added a simple test script to verify the structure of the visualization files
  • Manually tested the visualization features

Documentation

  • Added comprehensive documentation in docs/visualization_features.md
  • Added example usage in examples/enhanced_visualizations.py

Related Issues

This PR addresses the following issues:

  • ZAM-417: Comprehensive Analysis and Enhancement of Codegen Visualization Features
  • ZAM-421: Implementation of Enhanced Visualization UI with Selection Row
  • ZAM-422: Implementation of Call Graph Visualization Enhancements
  • ZAM-423: Implementation of Inheritance Hierarchy Visualization
  • ZAM-424: Implementation of Module Dependency Visualization Enhancements
  • ZAM-425: Testing and Validation of Enhanced Visualization Features
  • ZAM-426: Documentation of Enhanced Visualization Features
  • ZAM-427: Final Integration and Release of Enhanced Visualization Features

💻 View my workAbout Codegen

Summary by Sourcery

Integrate enhanced visualization capabilities by adding new graph creation utilities and corresponding VisualizationManager methods for inheritance hierarchies, call graphs, symbol dependencies, and module dependencies; extend JSON serialization and node metadata to support new graph types and interactive selection; and deliver complete documentation, example scripts, and test coverage for the new features.

New Features:

  • Add create_inheritance_graph and VisualizationManager.visualize_inheritance_hierarchy to render class inheritance hierarchies
  • Add create_call_graph and VisualizationManager.visualize_call_graph to render function call relationships
  • Add create_dependency_graph and VisualizationManager.visualize_dependency_graph to render symbol dependency graphs
  • Add create_module_dependency_graph and VisualizationManager.visualize_module_dependencies to render module/file dependency graphs

Enhancements:

  • Extend graph_to_json to support INHERITANCE, CALL_GRAPH, DEPENDENCY_GRAPH, and MODULE_DEPENDENCIES types
  • Augment VizNode and GraphType enums with new properties and graph types for enhanced visualizations
  • Add node selection metadata to support interactive selection in the visualization UI

Documentation:

  • Add comprehensive documentation in docs/visualization_features.md with usage examples for all visualization types

Tests:

  • Include unit tests for visualization utilities and VisualizationManager methods
  • Add manual and simple scripts to verify visualization file structures and node metadata

Chores:

  • Provide an example script (examples/enhanced_visualizations.py) demonstrating all enhanced visualization features

clee-codegen and others added 30 commits February 26, 2025 23:54
# Motivation

The **Codegen on OSS** package provides a pipeline that:

- **Collects repository URLs** from different sources (e.g., CSV files
or GitHub searches).
- **Parses repositories** using the codegen tool.
- **Profiles performance** and logs metrics for each parsing run.
- **Logs errors** to help pinpoint parsing failures or performance
bottlenecks.

<!-- Why is this change necessary? -->

# Content

<!-- Please include a summary of the change -->
see
[codegen-on-oss/README.md](https://github.com/codegen-sh/codegen-sdk/blob/acfe3dc07b65670af33b977fa1e7bc8627fd714e/codegen-on-oss/README.md)

# Testing

<!-- How was the change tested? -->
`uv run modal run modal_run.py`
No unit tests yet 😿 

# Please check the following before marking your PR as ready for review

- [ ] I have added tests for my changes
- [x] I have updated the documentation or added new documentation as
needed
Original commit by Tawsif Kamal: Revert "Revert "Adding Schema for Tool Outputs"" (codegen-sh#894)

Reverts codegen-sh#892

---------

Co-authored-by: Rushil Patel <rpatel@codegen.com>
Co-authored-by: rushilpatel0 <171610820+rushilpatel0@users.noreply.github.com>
Original commit by Ellen Agarwal: fix: Workaround for relace not adding newlines (codegen-sh#907)
Copy link

sourcery-ai bot commented May 17, 2025

Reviewer's Guide

This PR augments the visualization subsystem by extending the core JSON serializer to accept a graph_type parameter, introducing four new recursive graph-creation utilities, wiring them into the VisualizationManager via updated method signatures and dedicated visualize_* methods, enhancing the VizNode and GraphType enums to support the new modes and interactive metadata, and delivering complete documentation, examples, and tests to validate and demonstrate the new features.

Sequence Diagram for Generating Typed Graph Visualizations

sequenceDiagram
    title Sequence Diagram for Generating Typed Graph Visualizations
    participant ClientCode
    participant VisManager as VisualizationManager
    participant viz_utils
    participant FileSystem

    ClientCode->>+VisManager: visualize_X_graph(entity, options)
    Note over VisManager, viz_utils: X can be Inheritance, Call, Dependency, or Module
    VisManager->>+viz_utils: create_X_graph(entity, options)
    viz_utils-->>-VisManager: specificGraph
    VisManager->>+VisManager: write_graphviz_data(specificGraph, graph_type=GraphType.X_TYPE)
    VisManager->>+viz_utils: graph_to_json(specificGraph, None, GraphType.X_TYPE)
    viz_utils-->>-VisManager: graphJson
    VisManager->>+FileSystem: Write graphJson to file
    FileSystem-->>-VisManager: Success
    VisManager-->>-ClientCode: Visualization data written
Loading

Enum Diagram: Updates to GraphType

classDiagram
    class GraphType {
        <<Enumeration>>
        TREE
        GRAPH
        INHERITANCE
        CALL_GRAPH
        DEPENDENCY_GRAPH
        MODULE_DEPENDENCIES
    }
    note for GraphType "Added new graph types: INHERITANCE, CALL_GRAPH, DEPENDENCY_GRAPH, MODULE_DEPENDENCIES."
Loading

File-Level Changes

Change Details Files
Extended graph_to_json to support multiple GraphType outputs
  • Updated signature to accept optional graph_type
  • Added branches for inheritance, call, dependency, and module dependency types
  • Retained default tree and generic graph outputs
src/codegen/visualizations/viz_utils.py
Added specialized graph-creation utilities
  • Implemented create_inheritance_graph with depth-limited recursion
  • Implemented create_call_graph honoring max_depth and include_external
  • Implemented create_dependency_graph with recursive symbol dependencies
  • Implemented create_module_dependency_graph for file import graphs
src/codegen/visualizations/viz_utils.py
Enhanced VisualizationManager to expose new visualizations
  • Imported GraphType and new utilities
  • Extended write_graphviz_data signature to forward graph_type
  • Added visualize_inheritance_hierarchy, visualize_call_graph, visualize_dependency_graph, visualize_module_dependencies
src/codegen/visualizations/visualization_manager.py
Enriched enums with interactive metadata and new graph types
  • Added methods, parent_class, children_classes, dependencies, dependents, is_selected, description to VizNode
  • Extended GraphType enum with INHERITANCE, CALL_GRAPH, DEPENDENCY_GRAPH, MODULE_DEPENDENCIES
src/codegen/visualizations/enums.py
Delivered comprehensive documentation for enhanced features
  • Created docs/visualization_features.md describing usage of all new visualization types, options, and API
  • Included code snippets for interactive selection UI and advanced scenarios
docs/visualization_features.md
Expanded test suite to cover new utilities and flows
  • Added unit tests for each create_* utility and VisualizationManager methods
  • Added simple file-structure verification script
  • Added manual test script for VizNode and GraphType values
tests/test_visualizations.py
tests/simple_test.py
tests/manual_test_visualizations.py
Provided example CLI script demonstrating new visualizations
  • Authored enhanced_visualizations.py with argparse for each visualization mode
  • Showed usage patterns for inheritance, call, dependency, and module graphs
examples/enhanced_visualizations.py

Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

Copy link

korbit-ai bot commented May 17, 2025

By default, I don't review pull requests opened by bots. If you would like me to review this pull request anyway, you can request a review via the /korbit-review command in a comment.

Copy link

coderabbitai bot commented May 17, 2025

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Explain this complex logic.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai explain this code block.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and explain its main purpose.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Support

Need help? Join our Discord community for assistance with any issues or questions.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

Copy link
Author

codegen-sh bot commented May 17, 2025

I see a check failed - I'm on it! 🫡

💻 View my work

Copy link
Author

codegen-sh bot commented May 17, 2025

🧩 I need a bit more direction!

This task is complex - could you break it down into smaller steps?
For best results, try to add specific context, explicitly mention symbol names, etc.

Reach out to our Slack community channel for any help!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants