如何将pytorch数据集带入pandas dataframe

Question

我看过很多关于如何将 pandas 数据转换为 pytorch 数据集的代码。 但是，我还没有找到或无法弄清楚相反的做法。 ie Load pytorch dataset into pandas dataframe。我想把AG新闻加载到pandas。你能帮忙吗？ 谢谢。

from torchtext.datasets import AG_NEWS

Answer 1

您可以使用：

from torchtext.datasets import AG_NEWS

train, test = AG_NEWS()
df_train = pd.DataFrame(train, columns=['label', 'text'])
df_test = pd.DataFrame(test, columns=['label', 'text'])

Output：

>>> df_train.head()
   label                                               text
0      3  Wall St. Bears Claw Back Into the Black (Reute...
1      3  Carlyle Looks Toward Commercial Aerospace (Reu...
2      3  Oil and Economy Cloud Stocks' Outlook (Reuters...
3      3  Iraq Halts Oil Exports from Main Southern Pipe...
4      3  Oil prices soar to all-time record, posing new...


>>> df_test.head()
   label                                               text
0      3  Fears for T N pension after talks Unions repre...
1      4  The Race is On: Second Private Team Sets Launc...
2      4  Ky. Company Wins Grant to Study Peptides (AP) ...
3      4  Prediction Unit Helps Forecast Wildfires (AP) ...
4      4  Calif. Aims to Limit Farm-Related Smog (AP) AP...