Skip to content

Add EventTransform Jsonata reconciler and CRD#8456

Merged
knative-prow[bot] merged 7 commits intoknative:mainfrom
pierDipi:eventtransform-jsonata-reconciler
Feb 12, 2025
Merged

Add EventTransform Jsonata reconciler and CRD#8456
knative-prow[bot] merged 7 commits intoknative:mainfrom
pierDipi:eventtransform-jsonata-reconciler

Conversation

@pierDipi
Copy link
Member

@pierDipi pierDipi commented Feb 12, 2025 •
edited
Loading

Related to:

Proposed Changes

  • Add EventTransform CRD
  • Add EventTransform Jsonata reconciler

Pre-review Checklist

  • At least 80% unit test coverage
  • E2E tests for any new behavior
  • Docs PR for any user-facing impact
  • Spec PR for any new API feature
  • Conformance test for any change to the spec

Release Note

Add EventTransform API CRD.

Docs

@pierDipi
Add EventTransform Jsonata reconciler
57ece4c 
Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
@pierDipi
Add CRD
4873ac2 
Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
@pierDipi
Add reconciler to controller binary
e65361a 
Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
@knative-prow knative-prow bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 12, 2025
@knative-prow knative-prow bot requested review from Leo6Leo and creydr February 12, 2025 09:46
@knative-prow knative-prow bot added the size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. label Feb 12, 2025
@codecov
Copy link

codecov bot commented Feb 12, 2025 •
edited
Loading

Codecov Report

Attention: Patch coverage is 0% with 339 lines in your changes missing coverage. Please review.

Project coverage is 63.00%. Comparing base (a228d2b) to head (27fe8da).
Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
pkg/reconciler/eventtransform/eventtransform.go 0.00% 147 Missing ⚠️
pkg/reconciler/eventtransform/resources_jsonata.go 0.00% 134 Missing ⚠️
pkg/reconciler/eventtransform/controller.go 0.00% 49 Missing ⚠️
cmd/controller/main.go 0.00% 8 Missing ⚠️
cmd/schema/main.go 0.00% 1 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #8456      +/-   ##
==========================================
- Coverage   63.91%   63.00%   -0.91%     
==========================================
  Files         391      394       +3     
  Lines       23543    23882     +339     
==========================================
  Hits        15048    15048              
- Misses       7691     8030     +339     
  Partials      804      804

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

matzew
matzew reviewed Feb 12, 2025
View reviewed changes
cmd/schema/main.go
registry.Register(&flowsv1.Sequence{})
registry.Register(&flowsv1.Parallel{})
registry.Register(&eventingv1alpha1.EventPolicy{})
registry.Register(&eventingv1alpha1.EventTransform{})
Copy link
Member

@matzew matzew Feb 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this used to generate the actual CRD?

Asking because other new CRDs (e.g. JobSink or Integration source/sink are missing.
(I can add them in a separate PR)

Copy link
Member Author

@pierDipi pierDipi Feb 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Partially, this is to generate the schema part of the CRD

Copy link
Member Author

@pierDipi pierDipi Feb 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

but it's only for bootstrapping it to give an head start

go run ./cmd/schema/ dump EventTransform

matzew
matzew approved these changes Feb 12, 2025
View reviewed changes
Copy link
Member

@matzew matzew left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@knative-prow knative-prow bot added the lgtm Indicates that a PR is ready to be merged. label Feb 12, 2025
matzew
matzew reviewed Feb 12, 2025
View reviewed changes
pkg/reconciler/eventtransform/eventtransform.go
sourceslisters "knative.dev/eventing/pkg/client/listers/sources/v1"
)

type Reconciler struct {
Copy link
Member

@matzew matzew Feb 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: we could include a _test.go file. But can be done on separate PR

Copy link
Member Author

@pierDipi pierDipi Feb 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I'll follow up with unit and e2e tests

matzew
matzew reviewed Feb 12, 2025
View reviewed changes
pkg/reconciler/eventtransform/resources_jsonata.go
@@ -0,0 +1,176 @@
package eventtransform
Copy link
Member

@matzew matzew Feb 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: we could license header? and perhaps stash that file in a separate resources folder? Like others do?

Copy link
Member Author

@pierDipi pierDipi Feb 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added

@pierDipi
Add permissions
59e82ee 
Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
@pierDipi
Add selector to eventing filtered factory
41d4931 
Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
@knative-prow knative-prow bot removed the lgtm Indicates that a PR is ready to be merged. label Feb 12, 2025
@pierDipi
Add License header
3862b7a 
Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
@pierDipi
Add symlink
27fe8da 
Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
@pierDipi pierDipi requested a review from matzew February 12, 2025 13:24
matzew
matzew approved these changes Feb 12, 2025
View reviewed changes
Copy link
Member

@matzew matzew left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@knative-prow knative-prow bot added the lgtm Indicates that a PR is ready to be merged. label Feb 12, 2025
@knative-prow
Copy link

knative-prow bot commented Feb 12, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: matzew, pierDipi

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@pierDipi
Copy link
Member Author

pierDipi commented Feb 12, 2025

/test reconciler-tests

@knative-prow knative-prow bot merged commit 779992f into knative:main Feb 12, 2025
35 of 36 checks passed
matzew pushed a commit to matzew/eventing that referenced this pull request Mar 18, 2025
@pierDipi @matzew
Add EventTransform Jsonata reconciler and CRD (knative#8456)
d14153f 
* Add EventTransform Jsonata reconciler

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add CRD

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add reconciler to controller binary

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add permissions

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add selector to eventing filtered factory

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add License header

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add symlink

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

---------

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
openshift-merge-bot bot pushed a commit to openshift-knative/eventing that referenced this pull request Mar 18, 2025
@matzew @pierDipi
Transformer backports ocp 1.17 part i (#1198)
b67fdb9 
* Add EventTransform API types (knative#8447)

* Add EventTransform API

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Codegen

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Rename TransformList -> EventTransformList

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Fix lint errors

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

---------

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add EventTransform Jsonata reconciler and CRD (knative#8456)

* Add EventTransform Jsonata reconciler

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add CRD

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add reconciler to controller binary

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add permissions

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add selector to eventing filtered factory

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add License header

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Add symlink

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

---------

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* EventTransform: Reconcile address and service (knative#8458)

- Set address only once endpoints are available
- Add debug logging
- Fix semantic comparisons to avoid loops

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* EventTransform: Support transforming response from Sink (knative#8469)

This allows:
- propagating the response from Sink
- discarding the response from Sink
- transforming the response from Sink

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* chore: Adding missing sinks and sources to schema file (knative#8460)

:lipstick: Adding missing sinks and sources to schema file

Signed-off-by: Matthias Wessendorf <mwessend@redhat.com>

* Run make generate-release

Signed-off-by: Matthias Wessendorf <mwessend@redhat.com>

---------

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>
Signed-off-by: Matthias Wessendorf <mwessend@redhat.com>
Co-authored-by: Pierangelo Di Pilato <pierdipi@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@matzew matzew matzew approved these changes

@creydr creydr Awaiting requested review from creydr

@Leo6Leo Leo6Leo Awaiting requested review from Leo6Leo

Assignees

@matzew matzew

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@pierDipi @matzew