Questions tagged [python]
Use for data science questions related to the programming language Python. Not intended for general coding questions (which should be asked on Stack Overflow).
6,621 questions
Score of 0
0 answers
13 views
How to sample from a parquet file with polars?
I am trying to read a huge parquet file with polars.
My issue is that it doesn't really fit in memory. So, I want to get a sample from it.
Thus, I am trying to sample 100 rows to get an initial feel ...
- reputation score 101
Score of 0
0 answers
14 views
How to interpret an unstable learning curve on a model tuned with Hyberband Tuning? Incorrect code or weird model?
I have used Hyperband automatic tuning for an ANN model to predict price. After running the model with the automatic tuning, I am obtaining an R2 score of 1.00 that suggest overfitting, however, I am ...
- reputation score 11
Score of -1
1 answer
39 views
the difference between covariance matrix at python and R
i have realized there is two covariance matrices at data science. first is covariance matrix at python and the second is in R.
what the difference?
- reputation score 27
Score of 1
1 answer
40 views
Axis error when creating csr_matrix. from merge data
I get an error when creating a csr_matrix data. from two merged pd.read_csv() data.
the code is:
...
- reputation score 27
Score of 1
0 answers
39 views
What would be the best way to analyze the relationship between a chemical reaction network graph and a tuple using a GNN?
So, for an ongoing research project, I've been analyzing the topology of the chemical reaction network (CRN) of a planet's atmosphere. What I'd like to do is see if anything about the CRN can be ...
- reputation score 11
Score of 0
1 answer
44 views
definition and example of coords concept
What is coords at csr_matrix?. i confused when i print() my csr_matrix data. something that appear on my terminal is these:
...
- reputation score 27
Score of 3
0 answers
25 views
CLV Estimation: BTYD vs. Survival Analysis
I'm working on a project using the Elo Merchant Category Recommendation dataset (Kaggle). My goal is to perform Customer Segmentation base on their transactions by combining RFM metrics with Customer ...
- reputation score 31
Score of 0
0 answers
31 views
Neural network (NN) model loss is increasing with epochs
I am trying to make a Convolutional Neural Network (CNN) using only numpy and other basic libraries. As a first step though, I needed to test the regular NN layers first, so I currently have a regular ...
- reputation score 1
Score of 9
1 answer
656 views
Handling Profanity Censorship in BERTopic
I'm currently working in a dataset with censorship on profanity. Basically, fuck would be 4 heart emojis. Considering I'm trying to run a topic modelling w/ BERTopic, what kinda of preprocessing would ...
- reputation score 143
Score of 1
0 answers
25 views
What causes a model to have such an output?
I'm training CSDI model and the output is very suspicious?
Low diffusion steps? too high learning rate? nothing seems to change this behavior? some normalization issue that I'm not accounting for, I'...
- reputation score 151
Score of 5
1 answer
319 views
How to efficiently merge multiple CSV and JSON files into a single DataFrame using Pandas in Python
I am working with multiple data files in a folder where some files are in CSV format and others are in JSON format. I want to combine all of them into a single DataFrame for further analysis.
Here is ...
- reputation score 51
Score of 2
0 answers
21 views
Trying to understand if I'm implementing GluonTS sliding window splitting and validation set correctly
The documentation is a little bit confusing so I thought I would ask here to make sure, I'm using:
...
- reputation score 151
Score of 5
1 answer
61 views
Model's forecasts are not anchored correctly to the history
I'm implementing this paper
and trying to train it on a generated data and return full ground truths and a single forecast but the forecasts my model is producing are not anchored to the past series ...
- reputation score 151
Score of 7
4 answers
359 views
Calculating next row in binary matrix
if I have the binary matrix which looks something like this (this is only 10 rows of binary matrix, I have a dataset of a million rows, so you can see what the binary matrix looks like):
...
- reputation score 81
Score of 2
0 answers
55 views
GAN training (RGB to IR) High-quality results on training set, but blurry/hallucinated outputs on unseen test images
I am a 6th sem student and my mini project is IR pedestrian detection using yolo v8. My job is to train GAN(Pix2Pix-based) for the generation of synthetic IR images. I will give my code below. My 99th ...
- reputation score 21
