51 questions
-2
votes
1
answer
363
views
Apache-Apex : How to write data from kafka topic to hdfs filesystem?
I am trying to read dat from kafka topic and writing it to HDFS filesystem, I buid my project using the apex malhar from [ https://github.com/apache/apex-malhar/tree/master/examples/kafka].
...
0
votes
1
answer
155
views
Does apache apex have some Web UI
I'm quite new to Apache Apex platform. Does it have some web ui? I was able to run docker sandbox and some example app. Nevertheless, yarn tracking url points to 404 pages. For example http://...
1
vote
1
answer
66
views
Window ID resets to 0 after it reaches 59 in DTconsole
I am currently working on apache apex. My application gets reset after window ID 59 is reached and starts again from 0. I get an error which says that there is only 1 datanode running and no nodes are ...
0
votes
0
answers
2k
views
Failed to execute goal org.apache.maven.plugins:maven-resources
I am executing the mvn clean install -DskipTests -X command in apex-core folder lying under my work directory to run an apache apex application. But there is a build error which says :
Failed to ...
-1
votes
1
answer
88
views
package org.apache.apex.malhar.lib does not exist
I am trying to execute an apex application consisting of an operator which uses the malhar library for generating random strings. Even though I have included the malhar-library dependency in my pom....
1
vote
1
answer
296
views
Logging in Apache Apex using log4j in docker RTS sandbox
I would like to understand how I can see my application logs using log4j in Apache Apex when using the official RTS Test Sandbox in docker.
To be more specific, I would like to know where Apex stores ...
7
votes
1
answer
3k
views
Apache Apex vs Apache Flink
As both are streaming frameworks which processes event at a time, What are the core architectural differences between these two technologies/streaming framework?
Also, what are some particular use ...
1
vote
3
answers
128
views
Need architecture hint: Data replication into the cloud + data cleansing
I need to sync customer data from several on-premise databases into the cloud. In a second step, the customer data there needs some cleanup in order to remove duplicates (of different types). Based on ...
0
votes
2
answers
128
views
IBM Websphere MQ to Apache Apex Operator Stream?
I have been searching the INTERNET extensively for a way to use web-sphere MQ in Apache Apex to stream the MQ message through and into a DAG. However, there seems to be no IBM documentation on the ...
3
votes
0
answers
71
views
CouchbasePOJOSetOperator is causing start up problems when running Apache Apex app
I have a basic Apex stream with a Kafka input operator feeding into a Couchbase set operator. The Kafka sides works fine and have proven it by removing the couch operator. I have tried switching ...
2
votes
1
answer
92
views
Adding Input Operator Dynamically to a running Apache Apex application
Is it possible to add input operator for different source in the running Apex application?
For example: In an production environment, I am running an Apex application to read the text-file from input ...
2
votes
2
answers
175
views
Trying to run Apache Apex's Yahoo Finance example on YARN
I've downloaded Apache Apex 3.5.0 along with Malhar 3.5.0.
I've successfully started the apex client and submitted the Yahoo Finance demo example to our YARN cluster (running CDH 5.10). The cluster ...
2
votes
3
answers
105
views
Can an Input Operator be used in the middle of a DAG in Apache Apex
All examples of Apex say that the first operator of the DAG should be an input operator. Can this operator appear in the middle of the DAG somewhere.
Consider a case in which I have data to be ...
3
votes
2
answers
176
views
How to calculate network latency between operators in Apache Apex
Is there a way, using which we can predict the N/W latency between two different operators in Apache Apex.
In a situation where the data that is going to be used in an operator, resides on a ...
1
vote
1
answer
237
views
Maven archetype error while creating a new Apache Apex project
I am following the documentation related to the Apache Apex which helps create a startup project.
https://apex.apache.org/docs/apex-3.4/apex_development_setup/#creating-new-apex-project
While ...