Does the `-nl`, `--newline` option still make sense in all the datatools cli?

[rsdoiel]

The -nl, --newline option is causing confusion in xlxs2csv. Maybe drop the option as it doesn't make much since in this specific CLI.

Is there are need for lf2crlf and crlf2lf tool? This is something that came up in the discussion around the meaning of the option.

[rsdoiel]

John Treankler observed the following. The -nl, --newline options are confusing if you're coming from a Windows background. On Windows you're worried about EOL not EOF. So this is a documentation bug at least and easily remedied.

A software solution could also avoided the issue. If I am on running on Windows then the CRLF attribute of the Writer can be set appropraitely. See https://pkg.go.dev/encoding/csv#pkg-variables under "type Writer" section. That seems like something I could do across all the datatools cli.

When I get a chance I should take care of both.

[jtreankler-thinktrg]

Standardizing the EOL to match the O/S sounds like a grand idea.

Some O/S want LF and some want CR and some want CR+LF.

We carbon-based life forms mostly don't want to think about EOL.

[rsdoiel]

The updated man pages are included in the upcoming v1.3.0 release as is the option -crlf for cli that use a csv.Writer. The default value for -crlf option is OS dependent. If you're on Windows it will set to true otherwise it defaults to false. It can be set true or false explicitly on the command line, -crlf=true or -crlf=false. Thanks to John Treankler for the suggestion.

[rsdoiel]

Good morning, I have released v1.3.0 release of datatools. It includes a -crlf option on the command line tools that write CSV files. By default on Windows this should default to true and on macOS/POSIX the default is false. You can always explicitly set it incase you're on one OS and need to target files for another. I don't have done extensive testing on Windows. I would appreciate if you giving xlsx2csv a spin to confirm if the change is work for you. You should be able to install the new version of the tools from Powershell with ``` irm https://caltechlibrary.github.io/datatools/installer.ps1 | iex ``` If you need to roll back to the previous version follow the instructions at https://caltechlibrary.github.io/datatools/INSTALL.html to reinstall the older v1.2.12 version. All the best, Robert R. S. Doiel Applications Developer Digital Library Development ***@***.******@***.***> (626) 395-6428

…

________________________________ From: John Treankler ***@***.***> Sent: Thursday, January 30, 2025 6:48 PM To: caltechlibrary/datatools ***@***.***> Cc: R. S. Doiel ***@***.***>; Assign ***@***.***> Subject: Re: [caltechlibrary/datatools] Does the `-nl`, `--newline` option still make sense in all the datatools cli? (Issue #24) Standardizing the EOL to match the O/S sounds like a grand idea. Some O/S want LF and some want CR and some want CR+LF. We carbon-based life forms mostly don't want to think about EOL. — Reply to this email directly, view it on GitHub<#24 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AABJIPLMY4RZSFDJG6UVAGD2NLP7HAVCNFSM6AAAAABWFU3D46VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMRWGE4DKMZUGI>. You are receiving this because you were assigned.Message ID: ***@***.***>

[jtreankler-thinktrg]

@rsdoiel I got around to testing the 1.3.0 version of xlsx2csv.exe today and it performed flawlessly.

Thank you for the prompt turn-around!