从大型json数据集创建对象数组

Question

I am building my first larger application with AngularJS and am having difficulty building an array of objects for graphing data. Currently, I am taking an excel file and creating JSON data with SheetJS. There are on the order of 40,000 entries stored in a variable "jsonData" in the format:

My end goal is to graph the "Close Amount" per month for every airline. My idea is the creation of an array of objects that will store the airline name, and an array of claims data (called airlineData). I am having difficulty with looping through jsonData to add the desired info into the array of objects based on an if statement to see if that airline name has been added already.

I have the code on github- https://github.com/mikebly/tsa-luggage-analysis

For simplicity, here is my entire loop through jsonData:

for(i = 0; i < jsonData.length; i++){

    var date = XLSX.SSF.parse_date_code(jsonData[i]["Incident Date"],{date1904:false});
    var month = date.m; // Returns 1,2,3,...,12
    var airport = String(jsonData[i]["Airport Code"]);
    var airline = String(jsonData[i]["Airline Name"]);
    var claim = Number(jsonData[i]["Close Amount"]);
    claim = claim || 0; // Convert "-" to 0 for summing and average
    claimTotal += claim;

    // Build airport data array of objects to keep track of each airline's individual claims
    if(airlineData.includes(airline) == false){
      airlineData.name = airline;
      airlineData.claimTotal = claim;
    } else{
      continue;
    }

    // Build airline name array for dropdown box
    if (airlineNames.includes(airline) === false){
      airlineNames.push(airline);
    } else{
        continue;
    }

    // Build airport code array for dropdown box
    if (airportCodes.includes(airport) === false){
      airportCodes.push(airport);
    } else{
        continue;
    }

  }; // End loop through rows

My desired result would look something like:

 [{name:" ",claims:[]},
  {name:" ",claims:[]},
  {},
  //...
 ]

so I can select the desired dataset based on the name selected through a dropdown box.

Answer 1

I got the excel file and not sure if this is what you would like, average and sum per month is an object with keys of month-year.

 const dataPromise = fetch("https://raw.githubusercontent.com/amsterdamharu/amsterdamharu.github.io/master/data.txt") .then(response=>response.text()) .then( text=>{ const all = text.split("\\n").map(row=>row.trim()); const fields = all[0].split("\\t").map(f=>f.trim()); const info = all.slice(1).map( row=>row.split("\\t").map(item=>item.trim()) ); return info.map( (row)=> row.reduce( (result,field,index)=>{ result[fields[index]]=field; return result; }, {} ) ); } ); dataPromise.then( data=>{ const raw = data.reduce( (result,item)=>{ const name = item["Airline Name"]; const claims = (result[name] = (result[name] || {})); const date = new Date(item["Incident Date"]); const month = date.getMonth()+1; const year = date.getFullYear(); const claim = Number(item["Close Amount"].replace(/[^0-9\\.]/g,"")); if(isNaN(claim)){ debugger; } claims[`${month}-${year}`]=claims[`${month}-${year}`]||[]; claims[`${month}-${year}`].push(claim); return result; }, {} ); console.log("raw object:",raw); const objectAveragePerMonth = Object.keys(raw).map( name=>({ name, monthAverage:Object.entries(raw[name]).reduce( (result,[key,values])=>{ const noZeros = values.filter(m=>m);//remove zero values result[key] = (noZeros.length) ? noZeros.reduce((sum,item)=>sum+item,0)/noZeros.length : 0; return result; }, {} ) }) ); console.log("average per month:",objectAveragePerMonth); const objectSumPerMonth = Object.keys(raw).map( name=>({ name, totalPerMonth:Object.entries(raw[name]).reduce( (result,[key,values])=>{ result[key] = values.reduce((sum,item)=>sum+item,0); return result; }, {} ) }) ); console.log("sum per month",objectSumPerMonth); const objectTotal = Object.keys(raw).map( name=>({ name, total:Object.entries(raw[name]).reduce( (result,[key,values])=>result+values.reduce((sum,item)=>sum+item,0), 0 ) }) ); console.log("total per airline",objectTotal); } ); 

You could look at Array.prototype.reduce , Array.prototype.map and Object.keys to understand the code more.

Let me know if you need any help

Answer 2

Try the following:

 // Code goes here var jsonData = [{ "Airline Name":"American Airlines ", "Airport Code":"ORD", "Airport Name":"Chicago O'Hare International Airport", "Claim Number":2010030168888, "Claim Site":"Checked Baggage", "Claim Type":"Passenger Property Loss", "Close Amount":0, "Date Received":40231, "Disposition":"Deny", "Incident Date":40182.25, "Item Category":"Personal Electronics; Travel Accessories" }]; var map = {}; jsonData.forEach(function(obj){ if(!map[obj["Airline Name"]]) map[obj["Airline Name"]] = {}; map[obj["Airline Name"]].name = obj["Airline Name"]; map[obj["Airline Name"]].claims = map[obj["Airline Name"]].claims || []; map[obj["Airline Name"]].claims.push(obj["Claim Number"]); map[obj["Airline Name"]].claimTotal = map[obj["Airline Name"]].claimTotal !== undefined ? map[obj["Airline Name"]].claimTotal + obj["Close Amount"] : 0; }); var arr = Object.values(map); console.log(arr);