[英]How to base64 encode and decode a column in python pandas?
I read this post我读了这篇文章
but I do not want to encrypt the dataframe, just convert it to base 64. I import a carriage return delimited list of words into a dataframe with:但我不想加密数据帧,只需将其转换为 base 64。我将回车分隔的单词列表导入到数据帧中:
words = pd.read_table("sampleText.txt",names=['word'], header=None)
words.head()
that gives那给
word
0 difference
1 where
2 mc
3 is
4 the
then然后
words['words_encoded'] = map(lambda x: x.encode('base64','strict'), words['word'])
print (words)
gave给
word words_encoded
0 difference <map object at 0x7fad3e89e410>
1 where <map object at 0x7fad3e89e410>
2 mc <map object at 0x7fad3e89e410>
3 is <map object at 0x7fad3e89e410>
4 the <map object at 0x7fad3e89e410>
... ... ...
999995 distribution <map object at 0x7fad3e89e410>
999996 in <map object at 0x7fad3e89e410>
999997 scenario <map object at 0x7fad3e89e410>
999998 less <map object at 0x7fad3e89e410>
999999 land <map object at 0x7fad3e89e410>
[1000000 rows x 2 columns]
I dont understand why my encoded column refers to a map object and not the actual data so I tried:我不明白为什么我的编码列指的是地图对象而不是实际数据,所以我尝试了:
b64words = words.word.str.encode('base64')
print(b64words)
gives给
0 NaN
1 NaN
2 NaN
3 NaN
4 NaN
..
999995 NaN
999996 NaN
999997 NaN
999998 NaN
999999 NaN
Name: word, Length: 1000000, dtype: float64
Well,好,
That threw me so I read the linked answer above and tried这让我很失望,所以我阅读了上面的链接答案并尝试
import base64
def encode(text):
return base64.b64encode(text)
words['Encoded_Column'] = [encode(x) for x in words]
but got但得到
---------------------------------------------------------------------------
TypeError Traceback (most recent call last)
<ipython-input-89-8cf5a6f1f3a9> in <module>
2 def encode(text):
3 return base64.b64encode(text)
----> 4 words['Encoded_Column'] = [encode(x) for x in words]
<ipython-input-89-8cf5a6f1f3a9> in <listcomp>(.0)
2 def encode(text):
3 return base64.b64encode(text)
----> 4 words['Encoded_Column'] = [encode(x) for x in words]
<ipython-input-89-8cf5a6f1f3a9> in encode(text)
1 import base64
2 def encode(text):
----> 3 return base64.b64encode(text)
4 words['Encoded_Column'] = [encode(x) for x in words]
~/miniconda3/envs/p37cu10.2PyTo/lib/python3.7/base64.py in b64encode(s, altchars)
56 application to e.g. generate url or filesystem safe Base64 strings.
57 """
---> 58 encoded = binascii.b2a_base64(s, newline=False)
59 if altchars is not None:
60 assert len(altchars) == 2, repr(altchars)
TypeError: a bytes-like object is required, not 'str'
so I tried converting to a bytes like object like so:所以我尝试转换为像这样的对象的字节:
import base64
def encode(text):
btext = text.str.encode('utf-8')
return base64.b64encode(btext)
words['Encoded_Column'] = [encode(x) for x in words]
but got但得到
---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
<ipython-input-90-46db6d3688ba> in <module>
3 btext = text.str.encode('utf-8')
4 return base64.b64encode(btext)
----> 5 words['Encoded_Column'] = [encode(x) for x in words]
<ipython-input-90-46db6d3688ba> in <listcomp>(.0)
3 btext = text.str.encode('utf-8')
4 return base64.b64encode(btext)
----> 5 words['Encoded_Column'] = [encode(x) for x in words]
<ipython-input-90-46db6d3688ba> in encode(text)
1 import base64
2 def encode(text):
----> 3 btext = text.str.encode('utf-8')
4 return base64.b64encode(btext)
5 words['Encoded_Column'] = [encode(x) for x in words]
AttributeError: 'str' object has no attribute 'str'
in this C example they are also converting first to byte strings and then to base64 like but I cannot do this simple task in Python.I am falling down this rabbit hole and every attempt just gets me deeper.在这个C 示例中,他们也首先转换为字节字符串,然后转换为 base64 之类的,但我无法在 Python 中完成这个简单的任务。 I really appreciate any help that a clear minded person can give.我非常感谢一个头脑清晰的人可以提供的任何帮助。
map
returns an iterator, not a list, so pandas
simply assigned it to all of the slots in the newly formed "words_encoded" column. map
返回迭代,而不是一个列表,因此pandas
简单地在新形成的“words_encoded”列它分配给所有时隙。 Similarly, if you did words['all_ones'] = 1
, pandas
would assign a 1 down that column.同样,如果您执行words['all_ones'] = 1
, pandas
会在该列下分配 1。
Secondly, "base64" isn't a codec for strings, it works on bytes
.其次,“base64”不是字符串的编解码器,它适用于bytes
。 You have to choose a text encoding and then encode that.您必须选择一种文本编码,然后对其进行编码。 So,所以,
words['word_encoded'] = words.word.str.encode(
'utf-8', 'strict').str.encode('base64')
works except that this encoder puts a "\\n" on the end of the base64 string, which I find odd.除了这个编码器在 base64 字符串的末尾放了一个“\\n”,我觉得这很奇怪。 Instead, you can do one of the following相反,您可以执行以下操作之一
words['word_encoded'] = words.word.str.encode(
'utf-8', 'strict').apply(
base64.b64encode)
# or
words['word_encoded'] = [base64.b64encode(x.encode('utf-8', 'strict'))
for x in words.word]
Personally I think the first one is a bit more "pandas" as it generates the Series directly without an intermediate list.我个人认为第一个更像是“熊猫”,因为它直接生成系列而没有中间列表。
The solution in action行动中的解决方案
>>> import base64
>>> import pandas as pd
>>> words = pd.read_table("sampleText.txt",names=['word'], header=None)
__main__:1: FutureWarning: read_table is deprecated, use read_csv instead, passing sep='\t'.
>>> words['word_encoded'] = words.word.str.encode(
... 'utf-8', 'strict').str.encode('base64')
>>>
>>> words
word word_encoded
0 difference b'ZGlmZmVyZW5jZQ==\n'
1 where b'd2hlcmU=\n'
2 mc b'bWM=\n'
3 is b'aXM=\n'
4 the b'dGhl\n'
>>>
>>> words['word_encoded'] = words.word.str.encode(
... 'utf-8', 'strict').apply(
... base64.b64encode)
>>>
>>> words
word word_encoded
0 difference b'ZGlmZmVyZW5jZQ=='
1 where b'd2hlcmU='
2 mc b'bWM='
3 is b'aXM='
4 the b'dGhl'
>>>
>>> words['word_encoded'] = [base64.b64encode(x.encode('utf-8', 'strict'))
... for x in words.word]
>>>
>>> words
word word_encoded
0 difference b'ZGlmZmVyZW5jZQ=='
1 where b'd2hlcmU='
2 mc b'bWM='
3 is b'aXM='
4 the b'dGhl'
Simply delete .str from function body.只需从函数体中删除 .str 即可。 True code:真实代码:
import base64
def encode(text):
btext = text.encode('utf-8')
return base64.b64encode(btext)
words = {'1': 1, '2': 2, '3': 3, 'asdasd': 4}
words['Encoded_Column'] = [encode(x) for x in words]
print(words)
It's output is:它的输出是:
{'1': 1, '2': 2, '3': 3, 'asdasd': 4, 'Encoded_Column': [b'MQ==', b'Mg==', b'Mw==', b'YXNkYXNk']}
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.