堆栈内存溢出
  简体   繁体   English

使用逗号和负数将 Pandas Dataframe 转换为 Float

[英]Convert Pandas Dataframe to Float with commas and negative numbers

 原文  2017-02-12 19:41:11  9   1    python/ pandas/ dataframe

问题描述

I've read several posts about how to convert Pandas columns to float using pd.to_numeric as well as applymap(locale.atof).我读过几篇关于如何使用 pd.to_numeric 和 applymap(locale.atof) 将 Pandas 列转换为浮动的帖子。

I'm running into problems where neither works.我遇到了两个都不起作用的问题。

Note the original Dataframe which is dtype: Object注意原始数据框是 dtype: Object

df.append(df_income_master[", Net"])
Out[76]: 
Date
2016-09-30       24.73
2016-06-30       18.73
2016-03-31       17.56
2015-12-31       29.14
2015-09-30       22.67
2015-12-31       95.85
2014-12-31       84.58
2013-12-31       58.33
2012-12-31       29.63
2016-09-30      243.91
2016-06-30      230.77
2016-03-31      216.58
2015-12-31      206.23
2015-09-30      192.82
2015-12-31      741.15
2014-12-31      556.28
2013-12-31      414.51
2012-12-31      308.82
2016-10-31    2,144.78
2016-07-31    2,036.62
2016-04-30    1,916.60
2016-01-31    1,809.40
2015-10-31    1,711.97
2016-01-31    6,667.22
2015-01-31    5,373.59
2014-01-31    4,071.00
2013-01-31    3,050.20
2016-09-30       -0.06
2016-06-30       -1.88
2016-03-31            
2015-12-31       -0.13
2015-09-30            
2015-12-31       -0.14
2014-12-31        0.07
2013-12-31           0
2012-12-31           0
2016-09-30        -0.8
2016-06-30       -1.12
2016-03-31        1.32
2015-12-31       -0.05
2015-09-30       -0.34
2015-12-31       -1.37
2014-12-31        -1.9
2013-12-31       -1.48
2012-12-31         0.1
2016-10-31       41.98
2016-07-31          35
2016-04-30      -11.66
2016-01-31       27.09
2015-10-31       -3.44
2016-01-31       14.13
2015-01-31      -18.69
2014-01-31       -4.87
2013-01-31        -5.7
dtype: object

   pd.to_numeric(df, errors='coerce')
    Out[77]: 
    Date
    2016-09-30     24.73
    2016-06-30     18.73
    2016-03-31     17.56
    2015-12-31     29.14
    2015-09-30     22.67
    2015-12-31     95.85
    2014-12-31     84.58
    2013-12-31     58.33
    2012-12-31     29.63
    2016-09-30    243.91
    2016-06-30    230.77
    2016-03-31    216.58
    2015-12-31    206.23
    2015-09-30    192.82
    2015-12-31    741.15
    2014-12-31    556.28
    2013-12-31    414.51
    2012-12-31    308.82
    2016-10-31       NaN
    2016-07-31       NaN
    2016-04-30       NaN
    2016-01-31       NaN
    2015-10-31       NaN
    2016-01-31       NaN
    2015-01-31       NaN
    2014-01-31       NaN
    2013-01-31       NaN
    Name: Revenue, dtype: float64

Notice that when I perform the conversion to_numeric, it turns the strings with commas (thousand separators) into NaN as well as the negative numbers.请注意，当我执行转换为_numeric 时，它会将带逗号（千位分隔符）的字符串转换为 NaN 以及负数。 Can you help me find a way?你能帮我想办法吗？

EDIT:编辑：

Continuing to try to reproduce this, I added two columns to a single DataFrame which have problematic text in them.继续尝试重现这一点，我将两列添加到一个 DataFrame 中，其中包含有问题的文本。 I'm trying ultimately to convert these columns to float.我试图最终将这些列转换为浮动。 but, I get various errors:但是，我收到各种错误：

df
Out[168]: 
             Revenue Other, Net
Date                           
2016-09-30     24.73      -0.06
2016-06-30     18.73      -1.88
2016-03-31     17.56           
2015-12-31     29.14      -0.13
2015-09-30     22.67           
2015-12-31     95.85      -0.14
2014-12-31     84.58       0.07
2013-12-31     58.33          0
2012-12-31     29.63          0
2016-09-30    243.91       -0.8
2016-06-30    230.77      -1.12
2016-03-31    216.58       1.32
2015-12-31    206.23      -0.05
2015-09-30    192.82      -0.34
2015-12-31    741.15      -1.37
2014-12-31    556.28       -1.9
2013-12-31    414.51      -1.48
2012-12-31    308.82        0.1
2016-10-31  2,144.78      41.98
2016-07-31  2,036.62         35
2016-04-30  1,916.60     -11.66
2016-01-31  1,809.40      27.09
2015-10-31  1,711.97      -3.44
2016-01-31  6,667.22      14.13
2015-01-31  5,373.59     -18.69
2014-01-31  4,071.00      -4.87
2013-01-31  3,050.20       -5.7

Here is result of using the solution below:这是使用以下解决方案的结果：

print (pd.to_numeric(df.astype(str).str.replace(',',''), errors='coerce'))
Traceback (most recent call last):

  File "<ipython-input-169-d003943c86d2>", line 1, in <module>
    print (pd.to_numeric(df.astype(str).str.replace(',',''), errors='coerce'))

  File "/Users/Lee/anaconda/lib/python3.5/site-packages/pandas/core/generic.py", line 2744, in __getattr__
    return object.__getattribute__(self, name)

AttributeError: 'DataFrame' object has no attribute 'str'

1 个解决方案

解决方案1
 18 已采纳  2017-02-12 19:57:47

It seems you need replace , to empty strings :看来您需要replace ,来清空strings ：

print (df)
2016-10-31    2,144.78
2016-07-31    2,036.62
2016-04-30    1,916.60
2016-01-31    1,809.40
2015-10-31    1,711.97
2016-01-31    6,667.22
2015-01-31    5,373.59
2014-01-31    4,071.00
2013-01-31    3,050.20
2016-09-30       -0.06
2016-06-30       -1.88
2016-03-31            
2015-12-31       -0.13
2015-09-30            
2015-12-31       -0.14
2014-12-31        0.07
2013-12-31           0
2012-12-31           0
Name: val, dtype: object

print (pd.to_numeric(df.str.replace(',',''), errors='coerce'))
2016-10-31    2144.78
2016-07-31    2036.62
2016-04-30    1916.60
2016-01-31    1809.40
2015-10-31    1711.97
2016-01-31    6667.22
2015-01-31    5373.59
2014-01-31    4071.00
2013-01-31    3050.20
2016-09-30      -0.06
2016-06-30      -1.88
2016-03-31        NaN
2015-12-31      -0.13
2015-09-30        NaN
2015-12-31      -0.14
2014-12-31       0.07
2013-12-31       0.00
2012-12-31       0.00
Name: val, dtype: float64

EDIT:编辑：

If use append, then is possible dtype of first df is float and second object , so need cast to str first, because get mixed DataFrame - eg first rows are type float and last rows are strings :如果使用追加，那么第一个df的dtype可能是float而第二个object ，因此需要首先转换为str ，因为得到混合DataFrame - 例如第一行是float type ，最后一行是strings ：

print (pd.to_numeric(df.astype(str).str.replace(',',''), errors='coerce'))

Also is possible check types by:也可以通过以下方式检查types ：

print (df.apply(type))
2016-09-30    <class 'float'>
2016-06-30    <class 'float'>
2015-12-31    <class 'float'>
2014-12-31    <class 'float'>
2014-01-31      <class 'str'>
2013-01-31      <class 'str'>
2016-09-30      <class 'str'>
2016-06-30      <class 'str'>
2016-03-31      <class 'str'>
2015-12-31      <class 'str'>
2015-09-30      <class 'str'>
2015-12-31      <class 'str'>
2014-12-31      <class 'str'>
2013-12-31      <class 'str'>
2012-12-31      <class 'str'>
Name: val, dtype: object

EDIT1:编辑1：

If need apply solution for all columns of DataFrame use apply :如果需要为DataFrame的所有列应用解决方案，请使用apply ：

df1 = df.apply(lambda x: pd.to_numeric(x.astype(str).str.replace(',',''), errors='coerce'))
print (df1)
            Revenue  Other, Net
Date                           
2016-09-30    24.73       -0.06
2016-06-30    18.73       -1.88
2016-03-31    17.56         NaN
2015-12-31    29.14       -0.13
2015-09-30    22.67         NaN
2015-12-31    95.85       -0.14
2014-12-31    84.58        0.07
2013-12-31    58.33        0.00
2012-12-31    29.63        0.00
2016-09-30   243.91       -0.80
2016-06-30   230.77       -1.12
2016-03-31   216.58        1.32
2015-12-31   206.23       -0.05
2015-09-30   192.82       -0.34
2015-12-31   741.15       -1.37
2014-12-31   556.28       -1.90
2013-12-31   414.51       -1.48
2012-12-31   308.82        0.10
2016-10-31  2144.78       41.98
2016-07-31  2036.62       35.00
2016-04-30  1916.60      -11.66
2016-01-31  1809.40       27.09
2015-10-31  1711.97       -3.44
2016-01-31  6667.22       14.13
2015-01-31  5373.59      -18.69
2014-01-31  4071.00       -4.87
2013-01-31  3050.20       -5.70

print(df1.dtypes)
Revenue       float64
Other, Net    float64
dtype: object

But if need convert only some columns of DataFrame use subset and apply :但如果只需要转换DataFrame的某些列，请使用subset并apply ：

cols = ['Revenue', ...]
df[cols] = df[cols].apply(lambda x: pd.to_numeric(x.astype(str)
                                                   .str.replace(',',''), errors='coerce'))
print (df)
            Revenue Other, Net
Date                          
2016-09-30    24.73      -0.06
2016-06-30    18.73      -1.88
2016-03-31    17.56           
2015-12-31    29.14      -0.13
2015-09-30    22.67           
2015-12-31    95.85      -0.14
2014-12-31    84.58       0.07
2013-12-31    58.33          0
2012-12-31    29.63          0
2016-09-30   243.91       -0.8
2016-06-30   230.77      -1.12
2016-03-31   216.58       1.32
2015-12-31   206.23      -0.05
2015-09-30   192.82      -0.34
2015-12-31   741.15      -1.37
2014-12-31   556.28       -1.9
2013-12-31   414.51      -1.48
2012-12-31   308.82        0.1
2016-10-31  2144.78      41.98
2016-07-31  2036.62         35
2016-04-30  1916.60     -11.66
2016-01-31  1809.40      27.09
2015-10-31  1711.97      -3.44
2016-01-31  6667.22      14.13
2015-01-31  5373.59     -18.69
2014-01-31  4071.00      -4.87
2013-01-31  3050.20       -5.7

print(df.dtypes)
Revenue       float64
Other, Net     object
dtype: object

EDIT2:编辑2：

Solution for your bonus problem:奖金问题的解决方案：

df = pd.DataFrame({'A':['q','e','r'],
                   'B':['4','5','q'],
                   'C':[7,8,9.0],
                   'D':['1,000','3','50,000'],
                   'E':['5','3','6'],
                   'F':['w','e','r']})

print (df)
   A  B    C       D  E  F
0  q  4  7.0   1,000  5  w
1  e  5  8.0       3  3  e
2  r  q  9.0  50,000  6  r

#first apply original solution
df1 = df.apply(lambda x: pd.to_numeric(x.astype(str).str.replace(',',''), errors='coerce'))
print (df1)
   A    B    C      D  E   F
0 NaN  4.0  7.0   1000  5 NaN
1 NaN  5.0  8.0      3  3 NaN
2 NaN  NaN  9.0  50000  6 NaN

#mask where all columns are NaN - string columns
mask = df1.isnull().all()
print (mask)
A     True
B    False
C    False
D    False
E    False
F     True
dtype: bool
#replace NaN to string columns
df1.loc[:, mask] = df1.loc[:, mask].combine_first(df)
print (df1)
   A    B    C      D  E  F
0  q  4.0  7.0   1000  5  w
1  e  5.0  8.0      3  3  e
2  r  NaN  9.0  50000  6  r

暂无
暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 将 pandas DataFrame 中带逗号的数字字符串转换为浮点数 - Convert number strings with commas in pandas DataFrame to float 如何在 Pandas 中转换浮点数中的负字符串？ - How to convert negative strings in float numbers in pandas? 将带有逗号和负值的数字字符串转换为浮点数 [Pandas] - Convert number string with commas and negative values to float [Pandas] 将列中的字符串十进制数字转换为浮于Pandas DataFrame中 - Convert string decimal numbers in column to float in a Pandas DataFrame Python将字符串转换为带有负数的浮点错误 - Python convert string to float error with negative numbers 使用Python熊猫将（美国）负数转换为-欧洲人 - Convert (American) negative numbers to -Europeans with Python Pandas 在 DataFrame Pandas 中将字符串转换为数字 - Convert Strings to Numbers in DataFrame Pandas 熊猫：清理并将DataFrame转换为数字 - Pandas: clean & convert DataFrame to numbers 在熊猫数据框中将数字转换为 2 位浮点数 - Converting numbers to 2 digits float number in pandas dataframe Pandas 系列/数据框：使用逗号将字符串数字格式化为千位分隔符 - Pandas Series/Dataframe: Format string numbers with commas as Thousands Separators
相关标签
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM