8,575 questions
Best practices
0
votes
0
replies
43
views
Scheduling tasks inside a spring batch job using ThreadPoolTaskScheduler , how much can a jvm handle?
i have a spring batch job that runs every 10 minutes, gets the rows inserted in a table within the last 10 minutes and based on the insertion time of each row, it schedules an sms for them
once they ...
- 21
3
votes
0
answers
117
views
Parallel Spring Batch jobs mixing up data
I am trying to run a separate instance of a Spring Batch job for every file, up to 20 at a time. For some reason, the job is being launched with the same parameters multiple times (same filename + ...
- 2,310
0
votes
0
answers
31
views
Getting issues writing test to run End-to-End job flow using JobOperatorTestUtils after Spring Batch 6.0.2 migration
I have recently upgraded my test app to Spring Boot 4.0.2 (transitively upgraded my batch version to 6.0.2). Since the JobLauncherTestUtils is deprecated since 6.0 version, I'm trying to use the ...
Best practices
0
votes
0
replies
112
views
How to automatically detect and map multiple CSV formats into a single entity without unnecessary Java code?
I am building a Spring Boot 4.0.1 application using Spring Batch 6.0.1 to ingest bank transactions from multiple CSV sources (specifically N26 and Revolut).
The Problem
The files are all dropped into ...
- 51
-3
votes
1
answer
137
views
Spring Batch metadata tables are not automatically created in Spring Boot 4
I am trying to set up a Spring Batch project using Spring Boot 4.0.0
The application starts successfully, but the standard Spring Batch meta-data tables (e.g., BATCH_JOB_INSTANCE, BATCH_JOB_EXECUTION, ...
Best practices
0
votes
2
replies
56
views
Should we use GCP Cloud Run (not Cloud Run Jobs) for Java Spring Batch?
Currently, I have a Java Spring Batch source code that contains multiple batch jobs, with their execution schedules configured directly in the code. The application is currently running on a Windows ...
1
vote
2
answers
165
views
Spring Boot Batch 6.x: Job Parameters are null in Reader despite using @StepScope
I'm trying to pass job parameters from a REST controller to a batch job reader in Spring Boot Batch 6.x, but the parameters are always null in the reader. I'm using @StepScope and SpEL expressions as ...
Best practices
0
votes
2
replies
53
views
What is the most efficient way to validate file data against Couchbase documents using Spring Batch— N1QL timestamp range, KV lookups, or USE KEYS?
I have a validation use-case where an input file contains a list of records that were updated at a certain timestamp. I need to verify that the data in the file matches the data stored in Couchbase.
...
Best practices
0
votes
1
replies
98
views
Hibernate 5: Use @Transactional or manual Transaction with StatelessSession for batch inserts?
I’m migrating batch insert code from Hibernate 4 to Hibernate 5.1 and want to confirm the correct transactional pattern for StatelessSession.
Legacy code (Hibernate 4):
@Transactional
public void ...
- 67
Best practices
0
votes
0
replies
81
views
HikariCP: connection-timeout and maximum-pool-size with long running queries
I am using a Postgres database. I have configured it to support multi-tenancy with a different schema for each tenant.
Overnight, my Spring Boot application runs several processes in parallel (around ...
- 112
Best practices
0
votes
2
replies
49
views
Group and process unordered records in a CSV file with Spring Batch
A CSV file needs to be processed using Spring Batch where multiple rows could be grouped based on a field value. In the below sample, two lines in the CSV have the same GROUP_NAME with the value ...
- 43
0
votes
0
answers
71
views
"DefaultJpaDialect does not support custom isolation levels" when upgrading to spring batch 5
I am upgrading an app to newest Spring Boot 3, and because of that Spring Batch is upgraded to 5.2.3 (from 4.3.10).
The application did not persist batch states previously, it was using the "map ...
- 1,839
1
vote
1
answer
65
views
MultiResourceItemWriter does not work with transactional StaxEventItemWriter
I configured a StaxEventItemWriter like this:
@Bean
public StaxEventItemWriter<Foo> fooWriter() {
return new StaxEventItemWriterBuilder<Foo>()
.name("fooWriter")
...
- 45.3k
0
votes
0
answers
79
views
Partitioned batch intermittently delays In Message Processing
We run through a series of Spring Batch jobs, some normal some partitioned around a cluster. (still on Spring Batch 4.3.10). After a while (sometimes takes a couple of runs) we observe delays in the ...
- 659
0
votes
1
answer
83
views
Spring Batch write multiple chunks at once/ aggregate writing of chunks after reaching threshold
I am using Spring Batch for the first time.
Currently, my setup is as follows:
one Kafka reader, one item processor, one JDBC writer (custom one)
the Kafka reader reads items from Kafka
chunk size is ...
- 868
