DOC: How to use storage_option param here to integrate with GCP bucket?

[KayvanShah1]

Location of the documentation

https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_pickle.html

Documentation problem

How to use storage_option param here to integrate with GCP bucket?

Suggested fix for documentation

Please add some examples to pandas.DataFrame.to_{any_file_format}.html

take

[purna135]

Hello, I would like to work on this issue if it's not entirely finished! I noticed that it's still open.

Sure. Please take it. Thank you Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: Purna Chandra Mansingh ***@***.***> Sent: Thursday, January 27, 2022 12:48:18 PM To: pandas-dev/pandas ***@***.***> Cc: Juliewhitaker842 ***@***.***>; Assign ***@***.***> Subject: Re: [pandas-dev/pandas] DOC: How to use storage_option param here to integrate with GCP bucket? (#42066) Hello, I would like to work on this issue if it's not entirely finished! I noticed that it's still open. — Reply to this email directly, view it on GitHub<#42066 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AKEVOQ72LBFOPHSL4XNRVNDUYE5JFANCNFSM463JLNBQ>. Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. You are receiving this because you were assigned.Message ID: ***@***.***>

[purna135]

Hi @MarcoGorelli, do I need to set up a Google Cloud Storage and then demonstrate an example on how to store pandas DataFrame to GCS bucket?

[MarcoGorelli]

Hey @purnachandramansingh - yeah if it's possible to put together a simple example, I think it'd be useful. Otherwise we can close

[purna135]

Thanks for your response @MarcoGorelli, I am trying to propose a simple example, I will let you know soon.

[purna135]

Hi @MarcoGorelli, below is working to read/write data to GCS. Kindly have a look if I am doing right or not
Thanks

Integrate with GCP bucket

• Pandas accept URLs with the prefix "gcs://", and will use gcsfs to complete the IO operation.
• The IO functions take an argument storage_options, which will be passed to GCSFileSystem, for example:

Write DataFrame to Google Cloud Storage

df.to_pickle('gs://bucket-name/path/file-name.pkl', <other parameters>,  storage_options={"token": "credentials.json"})

Read DataFrame from Google Cloud Storage

df.read_pickle('gs://bucket-name/path/file-name.pkl', <other parameters>,  storage_options={"token": "credentials.json"})