6,098 questions
Best practices
0
votes
2
replies
162
views
How to compress data during HTTP upload (request body) without client-side web compression?
I want to compress the data being transferred in an API over HTTP, specifically during file upload from client to server.
Most examples I found focus on response compression (server → client) using ...
- reputation score 1
Score of 1
4 answers
238 views
Invoking tar.exe from PowerShell, can't input any more commands
I'm new to CLI and trying to use it instead of GUI options to get better at it.
Trying to extract a .gz archived pdf, but after running a command to see what happens it seems I can't input anything ...
- reputation score 27
Score of 1
1 answer
93 views
Efficiently proxying large Gzipped streams in FastAPI without decompression/recompression loop
I have a microservices architecture implemented with Python and FastAPI in AWS Lambda (No API Gateway). The data flow is roughly:
Client <-> Service A <-> Service B (Processor) <-> ...
- reputation score 91
Best practices
0
votes
5
replies
198
views
How do I read a gz file consisting of very long lines (not limited but up to GB's) line by line in C++?
How do I read a gz file consisting of very long lines (not limited but up to GB's) line by line in C++?
The solutions with zlib are limited to a buffer size but I don't know my limit.
- reputation score 173
Score of 1
2 answers
221 views
Decompressing and unpacking .tar.gz archive using Tcl 9.0
I have the following (working) shell command:
tar -x --directory "$inner" --strip-components 1 <"$inner.tar.gz"
It's part of a shell script I'm translating to Tcl. I can use ...
- reputation score 25198
Score of 0
0 answers
139 views
How to avoid per-process memory duplication when using rapidgzip with multiprocessing in Python?
I have a Python file:
from concurrent.futures import ProcessPoolExecutor
import tarfile, rapidgzip
def processNdjson(ndjsonName):
with rapidgzip.open(inTarDir) as myZip:
myZip....
- reputation score 2858
Score of 4
3 answers
227 views
How to gzip a string to a file so that it can be unzipped with regular gzip?
I want to serialize R objects as JSON for other programs to use, and gzip them for efficient transport. So I run
data <- list(foo = "bar")
readr::write_file(jsonlite::as_gzjson_b64(data), ...
- reputation score 10889
Score of 3
4 answers
363 views
Angular 15 'ng serve' builds app very slowly, every change is very slow
Im using angular v15 for my project. It's not small but not really big. I'd say medium to big. Running ng serve takes A LOT of time.
Build at: 2025-07-23T12:23:56.259Z - Hash: 5ba2b19880727f6c - Time: ...
- reputation score 86
Score of 2
1 answer
247 views
Is there a portable, simple, way to compress/decompress gzip in C?
I am relatively new to C programming. I am trying to write a parser for the Minecraft NBT data format (specification by Notch on the Wayback Machine).
However, I am running into a problem.
An NBT file ...
- reputation score 369
Score of 0
0 answers
58 views
Python tempfile SpooledTemporaryFile write to a gzip without writing to disk where possible?
I am trying to create a snippet of Python code that first writes a possibly large text file (think csv) to a SpooledTemporaryFile in memory. Then that spooled file is compressed with gzip. While some ...
- reputation score 1
Score of 7
1 answer
206 views
Compressing data twice with gzip with a high ratio the second time
Note the following gzip compressions:
$ seq 1000000 > file.txt
$ ls -l
total 6728
-rw-r--r--. 1 felix felix 6888896 jun 6 18:29 file.txt
$ gzip -f -k file.txt
$ ls -l
total 8808
-rw-r--r--. 1 ...
- reputation score 101
Score of 0
1 answer
75 views
Python save TemporaryFile read as "w+b" to compressed tarfile
I am given a SpooledTemporaryFile through FastAPI's UploadFile. My goal is to write it to disk so I can extract it and process its contents later. This seems simple, but I am having problems saving ...
- reputation score 45
Score of 0
1 answer
60 views
Can HTTP do chunked transfer while the page is gzipped
I'm working with embedded devices (STM32), the device would have a TCP server (HTTP server). The internal memory and flash is limited, so a more complex page wouldn't fit to the device. I would need ...
- reputation score 70
Score of 0
0 answers
60 views
Gzip files extraction
I am trying to extract .pkl files from the .zip files that are actually gzips. I have tried gunzip but it only works with .gzip extension.
I have tried the following but it gives me all the data (pkl,...
- reputation score 15
Score of 0
0 answers
112 views
wrangle function in pandas:ValueError: Mixing dicts with non-Series may lead to ambiguous ordering
I wrote a wrangle function that accepts a compressed JSON file as an argument and returns a dataframe after decompressing the file. The function ran well without error but when I attempted using the ...
- reputation score 9
