Single Pass Compiler: Tracking Issue

[masenf]

Overview

This is the tracking issue for the Single Pass Compiler (SPC) initiative — a ground-up rearchitecture of Reflex's compilation pipeline from a multi-pass, multi-threaded design to a single-pass, plugin-based architecture.

Goals

• Replace the current multi-pass tree walks with a single-pass plugin pipeline
• Make Component effectively immutable after construction
• Introduce a CompilerPlugin protocol with well-defined hooks and context objects
• Enable selective page recompilation and caching for faster dev iteration
• Replace StatefulComponent auto-memoization with rx._x.memo-based approach
• Remove legacy multi-threading/multiprocessing executor infrastructure
• Improve compiler output granularity (per-module JS, module_code in VarData, memo provenance tracking)
• Investigate single-port dev mode with internally-managed hot reload

Sub-Issues

Core Architecture

• Single-pass compiler: Introduce CompilerPlugin protocol, CompilerHooks, and context objects #6210 — Introduce CompilerPlugin protocol, CompilerHooks, and context objects
• Single-pass compiler: Implement core compilation plugins (imports, hooks, custom code, dynamic imports, refs) #6211 — Implement core compilation plugins (imports, hooks, custom code, dynamic imports, refs)
• Single-pass compiler: Wire plugin pipeline into App._compile() and remove multi-pass tree walks #6212 — Wire plugin pipeline into App._compile() and remove multi-pass tree walks

Component Model

• Single-pass compiler: Replace StatefulComponent auto-memoization with rx._x.memo-based approach #6213 — Replace StatefulComponent auto-memoization with rx._x.memo-based approach
• Single-pass compiler: Make Component effectively immutable #6214 — Make Component effectively immutable

Performance & Caching

• Single-pass compiler: Profile, benchmark, and optimize the new compilation pipeline #6215 — Profile, benchmark, and optimize the new compilation pipeline
• Single-pass compiler: Implement selective page recompilation and caching #6216 — Implement selective page recompilation and caching

Cleanup

• Single-pass compiler: Remove legacy multi-threading/multiprocessing executor infrastructure #6217 — Remove legacy multi-threading/multiprocessing executor infrastructure

Compiler Output Improvements

• Compiler: Track provenance of rx.memo components and output to mirrored Python paths #6218 — Track provenance of rx.memo components and output to mirrored Python paths
• Compiler: Add module_code field to VarData #6219 — Add module_code field to VarData

Future Investigation

• Investigate: Internally-managed hot reload with single-port dev mode #6221 — Investigate internally-managed hot reload with single-port dev mode

[linear]

ENG-9178