How to upload Junit report to update a multi-suite test plan (specification-first approach)?

[emmanuel-pedralvez]

I have a test plan with this structure:

Suite 1

• Test Case 1
• Test Case 2
• Test Case 3

Suite2

• Test Case 4
• Test Case 5
• Test Case 6

The structure of the junit report looks like this:

 <?xml version="1.0" encoding="utf-8"?>
   <testsuites>
      <testcase classname="classname" name="name" file="test_file.py" line="18" time="39.573">
            <properties>
                <property name="test_id" value="C183453" />
            </properties>
   </testsuites>

When I upload the the junit xml I encounter error:

KeyError: 'runs'

I displayed the logs for the api calls and saw this:

method: POST
url: <host>/api/v2/add_plan_entry/5490
payload: {'suite_id': 1425, 'description': '', 'milestone_id': None, 'case_ids': [183453, 183452, 182911, 183451, 182906, 182908, 182907, 182905, 182910, 182927, 182909, 182925, 182926, 182922, 182919, 182916, 182915, 182918, 182914, 182917, 185632, 185628, 185627, 185626, 187765, 187766, 187764, 186302, 185624, 185625, 185630, 185631, 186958, 185629, 186303, 186306, 186957, 186305, 186304, 183173, 183191, 183188, 185242, 185241, 
183174, 183193, 183192, 183184, 183179, 185240, 183175, 182960, 183183, 182976, 182955, 182956, 182959, 182954, 182958, 182975, 182966, 182963, 182977, 182972, 182968, 182971, 182967, 182969, 182970, 183024, 183027, 183025, 183023, 183026, 183030, 183032, 183035, 183033, 183034, 183031, 183521, 183172, 183171, 183180, 183182, 183181, 183178, 183176, 183177, 183536, 183555, 183554, 183190, 183189, 183186, 183187, 183185, 186913, 183454, 186931, 183407, 183414, 183415, 183417, 183595, 183416, 183450, 186927, 185116, 183462, 183594, 183463, 183560, 183561, 183559, 189926, 183562, 183565, 183564, 183563, 183566, 183567, 183567, 183557, 183556, 183459, 186932, 183460, 184326, 186928, 183424, 183456, 186930, 183601, 183725, 183602, 183599, 186898, 186929, 186899, 186902, 183418, 186905, 183446, 183419, 186882, 183197, 183528, 183527, 183445, 183435, 183436, 183437, 183438, 183623, 183440, 183439, 183443, 183441, 183196, 183444, 183195, 186879, 186901, 185239, 186900, 186904, 186903, 186897, 183539, 183724, 183529, 186897, 186886, 186729, 186878, 183652, 186881, 183698, 183697, 183703, 183702, 183706, 186789, 183673, 183671, 186712, 183625, 183634, 183666, 183670, 183665, 183696, 183668, 183672, 183669, 183644, 183643, 183639, 183638, 183640, 183641, 183642, 186709, 183646, 186709, 183627, 183647, 183626, 183522, 186711, 183520, 183740, 183664, 186792, 186791, 186790, 183705, 183704, 184302, 186883, 186880, 186727, 183781, 183676, 183677, 183674, 183685, 183684, 186728, 186912, 186911, 186913, 185114, 185110, 185111, 186910, 185143, 185142, 18516, 185144, 185145, 185134, 185132, 186907, 185116, 185136, 185139, 185138, 185133, 185122, 185124, 185123, 185125, 186906, 185127, 185128, 185126, 185130, 185131, 185154, 185150, 185120, 185138, 186959, 185137, 185112, 185135, 185115, 185113, 185190, 185177, 186909, 185175, 185178, 186908, 183008, 183004, 183007, 183003, 183005, 183006, 183021, 183019, 183020, 183022, 183016, 183015, 183012, 183011, 183013, 183014, 183620, 183616, 183619, 183618, 183617, 183615], 'include_all': False, 'name': 'test upload'}
response status code: 400
response body: {'error': 'Field :case_ids contains unrecognized case IDs.'}

I'm pretty sure all case_ids are existing already in TestRail

here's the command I ran:

trcli  -y --config  testrail_config.yaml parse_junit --case-matcher "property" --plan-id "5490"  -f junit/junit-report.xml --title "test upload"  

Did I miss anything?

[acuanico-tr-galt]

Hi @emmanuel-pedralvez I can see the following errors:

• KeyError: ‘runs’ - This likely means the response from add_plan_entry is missing the expected 'runs' key — most likely because TestRail rejected the request due to invalid case IDs.
• Field :case_ids contains unrecognized case IDs - TestRail is rejecting the request to attach the cases to a plan entry because; One or more of the case IDs do not belong to the specified suite or the suite_id used in the payload is incorrect or mismatched.

Suggestions:

• Use --run-id Instead of --plan-id - If the plan already contains the test run you want to upload to, and you know the specific run ID inside the plan, skip --plan-id entirely.
• Ensure Case IDs Belong to Suite Used in Plan - If you must use --plan-id, then, Get the suite ID that each group of case IDs belongs to then, Upload test results per suite, by specifying both --plan-id and --suite-id. (Repeat this for other suites and reports if your test results span multiple suites)