feature: cursor based postgresql adapter

[norberttech]

Resolves: #xxx

Change Log

---

Added

• cursor based extractor to postgresql adapter
• dsl and builder to cover cursors to postgresql library

Fixed

Changed

Removed

Deprecated

Security

[codecov]

Codecov Report

❌ Patch coverage is 0% with 126 lines in your changes missing coverage. Please review.
✅ Project coverage is 82.89%. Comparing base (048bc15) to head (2fabd54).
⚠️ Report is 1 commits behind head on 1.x.
✅ All tests successful. No failed tests found.

Additional details and impacted files

@@            Coverage Diff             @@
##              1.x    #2101      +/-   ##
==========================================
- Coverage   82.89%   82.89%   -0.01%     
==========================================
  Files        1164     1168       +4     
  Lines       41042    41168     +126     
==========================================
+ Hits        34023    34126     +103     
- Misses       7019     7042      +23     

Components	Coverage Δ
etl	90.52% <ø> (+0.89%)	⬆️
cli	85.76% <ø> (ø)
lib-array-dot	95.00% <ø> (ø)
lib-azure-sdk	60.01% <ø> (ø)
lib-doctrine-dbal-bulk	95.14% <ø> (ø)
lib-filesystem	80.44% <ø> (ø)
lib-types	88.98% <ø> (+1.51%)	⬆️
lib-parquet	68.25% <ø> (ø)
lib-parquet-viewer	83.04% <ø> (ø)
lib-snappy	90.18% <ø> (+0.46%)	⬆️
bridge-filesystem-async-aws	90.95% <ø> (ø)
bridge-filesystem-azure	89.38% <ø> (ø)
bridge-monolog-http	96.89% <ø> (ø)
bridge-openapi-specification	91.50% <ø> (ø)
symfony-http-foundation	72.32% <ø> (ø)
adapter-chartjs	86.33% <ø> (ø)
adapter-csv	89.30% <ø> (ø)
adapter-doctrine	91.50% <ø> (ø)
adapter-elasticsearch	97.02% <ø> (ø)
adapter-google-sheet	97.05% <ø> (ø)
adapter-http	65.94% <ø> (ø)
adapter-json	89.69% <ø> (ø)
adapter-logger	83.33% <ø> (ø)
adapter-meilisearch	97.77% <ø> (ø)
adapter-parquet	79.92% <ø> (ø)
adapter-text	86.84% <ø> (ø)
adapter-xml	82.66% <ø> (ø)

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+--------------------------+--------------------------------+------+-----+-----------------+--------------------+-----------------+
| benchmark                | subject                        | revs | its | mem_peak        | mode               | rstdev          |
+--------------------------+--------------------------------+------+-----+-----------------+--------------------+-----------------+
| CSVExtractorBench        | bench_extract_10k              | 1    | 1   | 5.782mb +0.20%  | 624.572ms +107.62% | ±0.00% -100.00% |
| DbalExtractorBench       | bench_extract_10k_keyset       | 1    | 1   | 35.111mb +0.03% | 640.562ms +186.04% | ±0.00% -100.00% |
| DbalExtractorBench       | bench_extract_10k_limit_offset | 1    | 1   | 35.111mb -0.02% | 497.668ms +177.58% | ±0.00% -100.00% |
| ExcelExtractorBench      | bench_extract_10k_ods          | 1    | 1   | 48.735mb +0.02% | 1.915s +105.53%    | ±0.00% -100.00% |
| ExcelExtractorBench      | bench_extract_10k_xlsx         | 1    | 1   | 49.598mb +0.02% | 3.121s +99.64%     | ±0.00% -100.00% |
| JsonExtractorBench       | bench_extract_10k              | 1    | 1   | 6.508mb +0.18%  | 2.059s +85.89%     | ±0.00% -100.00% |
| ParquetExtractorBench    | bench_extract_10k              | 1    | 1   | 11.761mb -0.06% | 15.042s +27.09%    | ±0.00% -100.00% |
| PostgreSqlExtractorBench | bench_extract_10k_cursor       | 1    | 1   | ERR             | 393.532ms +0.00%   | ±0.00% 0.00%    |
| PostgreSqlExtractorBench | bench_extract_10k_keyset       | 1    | 1   | 37.580mb +0.06% | 422.847ms +3.25%   | ±0.00% -100.00% |
| PostgreSqlExtractorBench | bench_extract_10k_limit_offset | 1    | 1   | 37.581mb +0.08% | 396.486ms +7.29%   | ±0.00% -100.00% |
| TextExtractorBench       | bench_extract_10k              | 1    | 1   | 5.781mb +0.20%  | 55.374ms +0.03%    | ±0.00% -100.00% |
| XmlExtractorBench        | bench_extract_10k              | 1    | 1   | 5.801mb +0.20%  | 676.916ms +2.73%   | ±0.00% -100.00% |
+--------------------------+--------------------------------+------+-----+-----------------+--------------------+-----------------+

Transformers

+---------------------------------+--------------------------+------+-----+------------------+--------------------+-----------------+
| benchmark                       | subject                  | revs | its | mem_peak         | mode               | rstdev          |
+---------------------------------+--------------------------+------+-----+------------------+--------------------+-----------------+
| RenameEntryTransformerBench     | bench_transform_10k_rows | 1    | 1   | 124.654mb +0.01% | 139.034ms +97.43%  | ±0.00% -100.00% |
| RenameEachEntryTransformerBench | bench_transform_10k_rows | 1    | 1   | 19.848mb +0.06%  | 181.290ms +155.08% | ±0.00% -100.00% |
+---------------------------------+--------------------------+------+-----+------------------+--------------------+-----------------+

Loaders

+-----------------------+----------------+------+-----+------------------+--------------------+-----------------+
| benchmark             | subject        | revs | its | mem_peak         | mode               | rstdev          |
+-----------------------+----------------+------+-----+------------------+--------------------+-----------------+
| CSVLoaderBench        | bench_load_10k | 1    | 1   | 47.937mb +0.02%  | 140.429ms +101.06% | ±0.00% -100.00% |
| DbalLoaderBench       | bench_load_10k | 1    | 1   | 35.086mb +0.08%  | 2.691s +142.22%    | ±0.00% -100.00% |
| JsonLoaderBench       | bench_load_10k | 1    | 1   | 82.768mb +0.01%  | 197.795ms +85.30%  | ±0.00% -100.00% |
| ParquetLoaderBench    | bench_load_10k | 1    | 1   | 794.676mb +0.01% | 18.808s -28.25%    | ±0.00% -100.00% |
| PostgreSqlLoaderBench | bench_load_10k | 1    | 1   | 37.600mb -0.04%  | 872.795ms +2.29%   | ±0.00% -100.00% |
| TextLoaderBench       | bench_load_10k | 1    | 1   | 19.213mb +0.06%  | 35.806ms +2.52%    | ±0.00% -100.00% |
+-----------------------+----------------+------+-----+------------------+--------------------+-----------------+

Building Blocks

+-------------------+----------------------------+------+-----+------------------+--------------------+-----------------+
| benchmark         | subject                    | revs | its | mem_peak         | mode               | rstdev          |
+-------------------+----------------------------+------+-----+------------------+--------------------+-----------------+
| EntryFactoryBench | bench_entry_factory        | 1    | 1   | 107.250mb +0.01% | 1.142s +116.54%    | ±0.00% -100.00% |
| EntryFactoryBench | bench_entry_factory        | 1    | 1   | 56.647mb +0.02%  | 592.461ms +123.37% | ±0.00% -100.00% |
| EntryFactoryBench | bench_entry_factory        | 1    | 1   | 16.329mb +0.07%  | 114.742ms +92.32%  | ±0.00% -100.00% |
| RowsBench         | bench_chunk_10_on_10k      | 2    | 1   | 95.149mb +0.01%  | 7.028ms +101.45%   | ±0.00% -100.00% |
| RowsBench         | bench_diff_left_1k_on_10k  | 2    | 1   | 112.542mb +0.01% | 518.187ms +114.29% | ±0.00% -100.00% |
| RowsBench         | bench_diff_right_1k_on_10k | 2    | 1   | 95.262mb +0.01%  | 59.028ms +143.29%  | ±0.00% -100.00% |
| RowsBench         | bench_drop_1k_on_10k       | 2    | 1   | 96.023mb +0.01%  | 6.168ms +322.12%   | ±0.00% -100.00% |
| RowsBench         | bench_drop_right_1k_on_10k | 2    | 1   | 96.023mb +0.01%  | 2.721ms +83.43%    | ±0.00% -100.00% |
| RowsBench         | bench_entries_on_10k       | 2    | 1   | 94.184mb +0.01%  | 5.162ms +50.45%    | ±0.00% -100.00% |
| RowsBench         | bench_filter_on_10k        | 2    | 1   | 94.713mb +0.01%  | 37.306ms +113.53%  | ±0.00% -100.00% |
| RowsBench         | bench_find_on_10k          | 2    | 1   | 94.713mb +0.01%  | 36.079ms +106.90%  | ±0.00% -100.00% |
| RowsBench         | bench_find_one_on_10k      | 10   | 1   | 93.402mb +0.01%  | 2.800μs +56.08%    | ±0.00% -100.00% |
| RowsBench         | bench_first_on_10k         | 10   | 1   | 93.402mb +0.01%  | 0.500μs +25.00%    | ±0.00% -100.00% |
| RowsBench         | bench_flat_map_on_1k       | 2    | 1   | 102.462mb +0.01% | 31.141ms +105.35%  | ±0.00% -100.00% |
| RowsBench         | bench_map_on_10k           | 2    | 1   | 131.889mb +0.01% | 127.835ms +76.12%  | ±0.00% -100.00% |
| RowsBench         | bench_merge_1k_on_10k      | 2    | 1   | 95.233mb +0.01%  | 2.902ms +132.80%   | ±0.00% -100.00% |
| RowsBench         | bench_partition_by_on_10k  | 2    | 1   | 98.624mb +0.01%  | 124.741ms +95.51%  | ±0.00% -100.00% |
| RowsBench         | bench_remove_on_10k        | 2    | 1   | 96.286mb +0.01%  | 6.845ms +93.46%    | ±0.00% -100.00% |
| RowsBench         | bench_sort_asc_on_1k       | 2    | 1   | 93.786mb +0.01%  | 86.040ms +104.17%  | ±0.00% -100.00% |
| RowsBench         | bench_sort_by_on_1k        | 2    | 1   | 93.787mb +0.01%  | 84.744ms +98.61%   | ±0.00% -100.00% |
| RowsBench         | bench_sort_desc_on_1k      | 2    | 1   | 93.786mb +0.01%  | 86.112ms +100.25%  | ±0.00% -100.00% |
| RowsBench         | bench_sort_entries_on_1k   | 2    | 1   | 95.845mb +0.01%  | 17.631ms +107.74%  | ±0.00% -100.00% |
| RowsBench         | bench_sort_on_1k           | 2    | 1   | 93.595mb +0.01%  | 61.131ms +94.99%   | ±0.00% -100.00% |
| RowsBench         | bench_take_1k_on_10k       | 10   | 1   | 93.402mb +0.01%  | 28.100μs +116.71%  | ±0.00% -100.00% |
| RowsBench         | bench_take_right_1k_on_10k | 10   | 1   | 93.402mb +0.01%  | 35.700μs +131.00%  | ±0.00% -100.00% |
| RowsBench         | bench_unique_on_1k         | 2    | 1   | 112.543mb +0.01% | 403.486ms +64.32%  | ±0.00% -100.00% |
| TypeDetectorBench | bench_type_detector        | 1    | 1   | 43.509mb +0.03%  | 622.466ms +86.76%  | ±0.00% -100.00% |
| TypeDetectorBench | bench_type_detector        | 1    | 1   | 12.567mb +0.09%  | 116.533ms +73.46%  | ±0.00% -100.00% |
+-------------------+----------------------------+------+-----+------------------+--------------------+-----------------+

Parquet Library

+--------------------+---------------------------------+------+-----+------------------+--------------------+-----------------+
| benchmark          | subject                         | revs | its | mem_peak         | mode               | rstdev          |
+--------------------+---------------------------------+------+-----+------------------+--------------------+-----------------+
| ParquetWriterBench | bench_write_batch               | 1    | 1   | 12.679mb -12.64% | 468.584ms +107.52% | ±0.00% -100.00% |
| ParquetWriterBench | bench_write_gzip                | 1    | 1   | 11.339mb +0.12%  | 385.529ms +76.34%  | ±0.00% -100.00% |
| ParquetWriterBench | bench_write_row_by_row          | 1    | 1   | 12.679mb -12.64% | 424.061ms +88.75%  | ±0.00% -100.00% |
| ParquetWriterBench | bench_write_snappy              | 1    | 1   | 12.679mb -12.64% | 326.731ms +44.15%  | ±0.00% -100.00% |
| ParquetWriterBench | bench_write_uncompressed        | 1    | 1   | 11.063mb +0.12%  | 395.583ms +105.76% | ±0.00% -100.00% |
| ParquetReaderBench | bench_page_headers              | 1    | 1   | 7.807mb +0.15%   | 4.495s +137.99%    | ±0.00% -100.00% |
| ParquetReaderBench | bench_read_metadata             | 1    | 1   | 6.501mb +0.18%   | 14.537ms +76.70%   | ±0.00% -100.00% |
| ParquetReaderBench | bench_read_schema               | 1    | 1   | 6.501mb +0.18%   | 15.585ms +88.89%   | ±0.00% -100.00% |
| ParquetReaderBench | bench_read_values_all_columns   | 1    | 1   | 10.078mb -0.07%  | 10.206s +31.54%    | ±0.00% -100.00% |
| ParquetReaderBench | bench_read_values_single_column | 1    | 1   | 7.375mb -0.09%   | 394.204ms -13.93%  | ±0.00% -100.00% |
| ParquetReaderBench | bench_read_values_with_limit    | 1    | 1   | 7.902mb -0.24%   | 32.500ms +36.94%   | ±0.00% -100.00% |
+--------------------+---------------------------------+------+-----+------------------+--------------------+-----------------+