You are reading a single comment by @hurricane_run and its replies. Click here to read the full conversation.
  • I just need to do a YouTube course / tutorial as this is just not working for me.

    I have:

    1. Joined 2 csv (same headers, c.140k rows x 77 columns)
    2. Removed some columns
    3. Added some columns concat'ing other columns for UIDs
    4. Made a flag when a date in one column is older than today
    5. Removed duplicates from a new UID column
    6. Removed a column I sort of wanted which contains numbers and blanks where the numbers are whole and to 1 decimal point, because I'm getting an error ( [DataFormat.Error] We couldn't convert to Number) when I try and close and load that says it can't convert the numbers.

    But the whole thing won't load (black=what I want, red=source, purple=removed column I thought was the problem)

    It feels like there is a fundamental concept I am missing about how PQ works. I literally just want the sheet for the work I've done thus far so I can do my lookups as I'm getting no where. But now I can't even do that.

    I was hoping I'd be able to do 90% of my steps on this stupid massive sheet to get it down to a manageable size, while also having each step neatly labeled and also being able to copy the code from the Advanced Editor so I can perform all these steps again with new data ( the 2 source csv have a consistent name with each days date).

    Now thoroughly depressed. But have also locked onto it and am struggling to let it go.

  • You just need to take time and debug the shit out of this. Review the errors - I usually set TYPE as TEXT in those columns and filter out any shit data then change type afterwards. Welcome to the world of shit big data that shouldn't be anywhere near a spreadsheet.

About