I am using Spark3.0.1 I have following data as csv: 348702330256514,37495066290,9084849,33946,614677375609919,11-02-2018 0:00:00,GENUINE 34870233025 ...

I have the following data: I would like to transform it into a dataframe like the following: I tried the following: But im getting: ...

I am asking myself the question: "When should you use scala.concurrent.blocking?" If I understood correctly, the blocking {} only makes sense to be u ...

How can i match if two RDD generated the way i did contains the same data including number of rows? I'm using scala test to run the tests and spark ve ...

Problem statement : I have a csv file with around 100+ fields.I need to perform transformation on these fields and generate new 80+ fields and write o ...

I want to use scala and spark to implement Graph algorithm GraphSAGE, then how to do it? Is there any source code? I want to get the code for my ques ...

An example: _4 is a collection of count, date and tag that I want to group and sum The output I'm hoping for is something like this which groups by ...

Gatling - Scala (How to solve "Can't cast attribute ' cursorID' of type class java.lang.String into class scala.Option?) I am executing cursor based ...

I have two sequences of tuples: I need to obtain a new sequence by comparing the value of Long parameters by tuples. The comparison criterion is: i ...

I am trying to incorporate better monadic for into a project for it's lovely tuple desugaring which doesn't appear to be working currently. I have: ...

Here is a code that requires a change: When we run a job, 'activityDate' might return null as a result of query since there might not be any data i ...

I have the following model: Is there some way, at the type level, I can enforce that the request/response pair match together? So if SayHelloReques ...

In Scala 2, you can of course use use wildcard or existential types as type arguments. However, this means that you do not always have a name for a ty ...

I have been able to get a List of attributes for a case class using scala with Reflection. However, the .equals does not work, but gives no erro ...

I am learning Scala, and am trying to filter a select few columns from a large nested json file to make into a DataFrame. This is the gist of the json ...

I have the following code that makes a simple POST request. How it should work? Before I have made a request, I generate a testing value "orderName1" ...

I would like to use an idiomatic (std::algorithm or similar) version of Scala's .grouped in C++. This breaks a sequence into groups of size N where th ...

Output the word (or list of words) that occurs the most times in the text file (irrespective of case – i.e. “word” and “Word” are treated the same for ...

I read this statement: By using User.getClass, you are referring to the class companion object that Scala by default creates for the case class, a ...

I am looking at getting case class definitions. From SO I gleaned this practice as per Get field names list from case class, the answer using reflect ...