Level Extreme platform
Subscription
Corporate profile
Products & Services
Support
Legal
Français
Quick way to find number of lines in 16GB file
Message
From
08/06/2020 03:51:20
Dragan Nedeljkovich (Online)
Now officially retired
Zrenjanin, Serbia
 
 
To
07/06/2020 16:29:25
John Ryan
Captain-Cooker Appreciation Society
Taumata Whakatangi ..., New Zealand
General information
Forum:
Windows
Category:
Computing in general
Miscellaneous
Thread ID:
01674670
Message ID:
01674741
Views:
59
>>>The other issue was that few rows had extra , inside the column (I found these rows and removed that text). This was why originally I was unable to load it directly.
>
>IME the presence of commas without quote delimiters and the sneaky included CRLF, is the biggest cause of cost overrun processing new import files. Even with defined formats like HL7 that are supposed to disallow CRLF, somehow they're there!

My true and tried way of dealing with such files was to import them into LibreOffice's Calc and then export them as tab delimited with quotation marks around every string. This worked every time. Sometimes, though, perhaps because of some imperfection in my import routine, it would require an extra character column on the right.

Not easy, but at least I got the process automated and it happily ate whichever files I threw it over about seven years, from dozens of different sources.

back to same old

the first online autobiography, unfinished by design
What, me reckless? I'm full of recks!
Balkans, eh? Count them.
Previous
Next
Reply
Map
View

Click here to load this message in the networking platform