Questions tagged [python]
Use for data science questions related to the programming language Python. Not intended for general coding questions (which should be asked on Stack Overflow).
6,621 questions
Score of 0
0 answers
12 views
Machine learning approach for real-time job market forecasting
I'm planning to build a real-time job market intelligence web app for the data science and ai job market.
the application will continuously collect job postings, extract information such as skills, ...
- reputation score 21
Score of 1
1 answer
34 views
How to sample from a parquet file with polars?
I am trying to read a huge parquet file with polars.
My issue is that it doesn't really fit in memory. So, I want to get a sample from it.
Thus, I am trying to sample 100 rows to get an initial feel ...
- reputation score 111
Score of 0
0 answers
18 views
How to interpret an unstable learning curve on a model tuned with Hyberband Tuning? Incorrect code or weird model?
I have used Hyperband automatic tuning for an ANN model to predict price. After running the model with the automatic tuning, I am obtaining an R2 score of 1.00 that suggest overfitting, however, I am ...
- reputation score 11
Score of -1
1 answer
43 views
the difference between covariance matrix at python and R
i have realized there is two covariance matrices at data science. first is covariance matrix at python and the second is in R.
what the difference?
- reputation score 45
Score of 1
1 answer
41 views
Axis error when creating csr_matrix. from merge data
I get an error when creating a csr_matrix data. from two merged pd.read_csv() data.
the code is:
...
- reputation score 45
Score of 1
0 answers
43 views
What would be the best way to analyze the relationship between a chemical reaction network graph and a tuple using a GNN?
So, for an ongoing research project, I've been analyzing the topology of the chemical reaction network (CRN) of a planet's atmosphere. What I'd like to do is see if anything about the CRN can be ...
- reputation score 11
Score of 0
1 answer
44 views
definition and example of coords concept
What is coords at csr_matrix?. i confused when i print() my csr_matrix data. something that appear on my terminal is these:
...
- reputation score 45
Score of 4
1 answer
33 views
CLV Estimation: BTYD vs. Survival Analysis
I'm working on a project using the Elo Merchant Category Recommendation dataset (Kaggle). My goal is to perform Customer Segmentation base on their transactions by combining RFM metrics with Customer ...
- reputation score 41
Score of 0
0 answers
31 views
Neural network (NN) model loss is increasing with epochs
I am trying to make a Convolutional Neural Network (CNN) using only numpy and other basic libraries. As a first step though, I needed to test the regular NN layers first, so I currently have a regular ...
- reputation score 1
Score of 9
1 answer
657 views
Handling Profanity Censorship in BERTopic
I'm currently working in a dataset with censorship on profanity. Basically, fuck would be 4 heart emojis. Considering I'm trying to run a topic modelling w/ BERTopic, what kinda of preprocessing would ...
- reputation score 143
Score of 1
0 answers
25 views
What causes a model to have such an output?
I'm training CSDI model and the output is very suspicious?
Low diffusion steps? too high learning rate? nothing seems to change this behavior? some normalization issue that I'm not accounting for, I'...
- reputation score 151
Score of 5
1 answer
330 views
How to efficiently merge multiple CSV and JSON files into a single DataFrame using Pandas in Python
I am working with multiple data files in a folder where some files are in CSV format and others are in JSON format. I want to combine all of them into a single DataFrame for further analysis.
Here is ...
- reputation score 51
Score of 2
0 answers
21 views
Trying to understand if I'm implementing GluonTS sliding window splitting and validation set correctly
The documentation is a little bit confusing so I thought I would ask here to make sure, I'm using:
...
- reputation score 151
Score of 5
1 answer
61 views
Model's forecasts are not anchored correctly to the history
I'm implementing this paper
and trying to train it on a generated data and return full ground truths and a single forecast but the forecasts my model is producing are not anchored to the past series ...
- reputation score 151
Score of 7
4 answers
362 views
Calculating next row in binary matrix
if I have the binary matrix which looks something like this (this is only 10 rows of binary matrix, I have a dataset of a million rows, so you can see what the binary matrix looks like):
...
- reputation score 81
