cp: Update instructions for AWS credentials in ArXiv download and extract tutorial (1380) into r1.1.0

[pablo-garay]

beep boop [🤖]: Hi @sarahyurick 👋,

we've cherry picked #1380 into  for you! 🚀

Please review and approve this cherry pick by your convenience!

[pablo-garay]

/ok to test 94f07de

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[greptile-apps]

Greptile Summary

This PR cherry-picks documentation improvements from #1380 into the r1.1.0 branch. The changes relocate AWS credential setup instructions to the beginning of the notebook (before Ray client initialization) and improve the S3 bucket accessibility test by replacing a shell command with proper Python subprocess handling.

Key improvements:

• Moved AWS credential configuration cells from the ArXiv section to the prerequisites section at the top of the notebook
• Added explicit warning that credentials must be set before starting the Ray client to avoid credential-related errors
• Added guidance about not including quotes when setting environment variables
• Replaced !s5cmd shell command with subprocess.run() for better error handling and output capture
• Included # noqa: S602 comment to suppress security linter warning about shell=True usage (acceptable here since the command string is hardcoded)

Confidence Score: 5/5

• This PR is safe to merge with no concerns - it's a clean cherry-pick of documentation improvements
• The changes are limited to documentation and tutorial improvements with no functional code changes. The subprocess implementation is correct with appropriate security annotations, and the reorganization of credential setup improves the user experience by preventing common setup errors
• No files require special attention

Important Files Changed

Filename	Overview
tutorials/text/download-and-extract/download_extract_tutorial.ipynb	Moved AWS credential setup to notebook prerequisites section and improved s5cmd command with proper Python subprocess handling

Sequence Diagram

sequenceDiagram
    participant User
    participant Notebook
    participant Environment
    participant Ray
    participant ArXiv

    User->>Notebook: Set AWS credentials (top of notebook)
    Notebook->>Environment: Export AWS environment variables
    Note over Notebook,Environment: Credentials must be set<br/>before Ray initialization

    User->>Notebook: Start Ray client
    Notebook->>Ray: RayClient().start()
    Ray-->>Notebook: Ray cluster ready

    User->>Notebook: Test S3 access
    Notebook->>ArXiv: subprocess.run(s5cmd ls)
    ArXiv-->>Notebook: List of .tar files
    Notebook->>User: Display results

    User->>Notebook: Run ArxivDownloadExtractStage
    Notebook->>ArXiv: Download .tar files
    ArXiv-->>Notebook: Downloaded files
    Notebook->>Notebook: Extract LaTeX sources
    Notebook->>User: Return results as DataFrames

Loading