>>>The other issue was that few rows had extra , inside the column (I found these rows and removed that text). This was why originally I was unable to load it directly.
>
>IME the presence of commas without quote delimiters and the sneaky included CRLF, is the biggest cause of cost overrun processing new import files. Even with defined formats like HL7 that are supposed to disallow CRLF, somehow they're there!
My true and tried way of dealing with such files was to import them into LibreOffice's Calc and then export them as tab delimited with quotation marks around every string. This worked every time. Sometimes, though, perhaps because of some imperfection in my import routine, it would require an extra character column on the right.
Not easy, but at least I got the process automated and it happily ate whichever files I threw it over about seven years, from dozens of different sources.