a. Clone GraphQA repo.
To evaluate CodeGraph on GraphQA benchmark, please first clone the repo of graphqa and place it under the following folder structure.
Folder structure
CodeGraph/
├── codegraph/
├── docs/
├── graphqa/
├── models/
├── README.md
├──run_parallel_cg_graph_generator_with_diff_exemplar.sh
└── ...
b. Generating graphs.
-
Navigate to the Project Directory
cd CodeGraph -
Modify the Output Path modify the output path in
graph_generator.shunder thegraphqafolderOUTPUT_PATH="graphqa/graphs" -
Generate Graphs for Test Set
./graphqa/graph_generator.sh
-
Generate Graphs for Train Set
Step 1
To generate graphs for the
trainsplit instead of thetestsplit, modify the--splitin graph_generator.sh:--split=train
Step 2
./graphqa/graph_generator.sh