在python的字典中创建字典，读取一些数据是csv文件

Question

I have a csv file called sample.csv which contains the following data:-

2014-07-18 01:00:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10002
2014-07-18 01:00:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10003
2014-07-18 01:15:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10004
2014-07-18 01:15:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10005
2014-07-18 01:30:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10006
2014-07-18 01:30:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10007
2014-07-18 01:45:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10008
2014-07-18 01:45:00,UNKNOWN,UNKNOWN,UNKNOWN,UNKNOWN,10009

I am trying to write a python script that would read all the lines in this csv file and I want it to read the hour which is '01' here and make the hour as the head key and then make the minute as the subkey and the remaining fields as its values.

Here is my code snippet:-

def connection():
        os.chdir("record_output/")
        mydict = {}
        for files in glob.glob("*.csv"):
                fo = open(files, "r")
                data = fo.readlines()
                for lines in data:
                        lines = lines.split(',')
                        dateObject = datetime.strptime(lines[0],"%Y-%m-%d %H:%M:%S")
                        hour = dateObject.hour
                        minute = dateObject.minute
                        fields = lines[1:]

Here I get the hour, the minute and the remaining fields but kinda struggling in creating the desired output that is making hour as the head key, the minute as the subkey and the corresponding fields as the values and so on for every minute in that hour that is '00', '15', '30' and '45' and for every hour. Currently there is only 1 hour in this csv file, in future there can be more than 1 hour.

Answer 1

Check if key exists before insert a new value (this will be inside your las loop)

if not mydict.has_key(hour):
    mydict[hour] = {}
mydict[hour][minute]=fields

Unchecked but should work. Should let you something like:

{1: {33: 22, 34: 25}}

Been 1 the hour, 33 and 34 the minutes and 22, 25 the values (can be strings or whatever)

EDIT: True, the minutes must be arrays to store many values in the same minute, so do the same with minutes, letting it this way:

if not mydict.has_key(hour):
    mydict[hour] = {}

if not mydict[hour].has_key(minute):
    # A list here, cause you don't have more keys
    mydict[hour][minute] = [] 

mydict[hour][minute].append(fields)

So the output should be this way:

{1: {33: ["a value, undefinde,...", 22, "test1"], 34: [33, "test2", "test945723"]}}

EDIT II: The final code will be:

def connection():
        os.chdir("record_output/")
        mydict = {}
        for files in glob.glob("*.csv"):
                fo = open(files, "r")
                data = fo.readlines()
                for lines in data:
                        lines = lines.split(',')
                        dateObject = datetime.strptime(lines[0],"%Y-%m-%d %H:%M:%S")
                        hour = dateObject.hour
                        minute = dateObject.minute
                        fields = lines[1:]

                        if not mydict.has_key(hour):
                                mydict[hour] = {}

                        if not mydict[hour].has_key(minute):
                                # A list here, cause you don't have more keys
                                mydict[hour][minute] = [] 

                        mydict[hour][minute].append(fields)

If don't works check your loop:

fo = open(files, "r")
  data = fo.readlines()
  for lines in data:
    print lines

And try changing:

  for row in data:
    lines = row.split(',')

with a new field called

  for row in data:
    lines = row.split(',')

And put 'print's to debug the program.

Answer 2

A solution with csv module

import dateutil.parser
import csv

data_dict = {}
with open('data.csv', 'r') as csvfile:
    csvreader = csv.reader(csvfile)
    for row in csvreader:
        dt = dateutil.parser.parse(row[0])
        if not data_dict.get(dt.hour,''):
            data_dict[dt.hour] = {}
        if not data_dict[dt.hour].get(dt.minute,''):
            data_dict[dt.hour][dt.minute]=[]
        data_dict[dt.hour][dt.minute].append(row[1:])