{"id":6976,"date":"2019-10-02T09:55:58","date_gmt":"2019-10-02T09:55:58","guid":{"rendered":"https:\/\/stackify.com\/?p=6976"},"modified":"2024-03-19T12:10:15","modified_gmt":"2024-03-19T12:10:15","slug":"java-performance-tools-8-types-tools-need-know","status":"publish","type":"post","link":"https:\/\/stackify.com\/java-performance-tools-8-types-tools-need-know\/","title":{"rendered":"Java Performance Monitoring Tools: 9 Types of Tools You Need to Know!"},"content":{"rendered":"\n

Monitoring an application’s performance is one of the hardest challenges in software development. That’s true for virtually any programming language and platform. Java performance monitoring presents some unique challenges of its own.<\/p>\n\n\n\n

For instance, one of those challenges has to do with garbage collection. Java features automatic memory management, which frees the developer from having to manually dispose of obsolete objects.<\/p>\n\n\n\n

\"Garbage<\/figure>\n\n\n\n

But you know what they say about free lunches. Garbage collection has a cost: too many collections will take its toll on performance.<\/p>\n\n\n\n

Garbage collection apart, Java performance monitoring is an ongoing task, so it is important to have the right tools.<\/p>\n\n\n\n

And that’s what today’s post is all about. We’re going to cover nine Java performance monitoring tools. Or rather, nine types of performance tools.<\/p>\n\n\n\n

After learning about these broads categories, you’ll be able to analyze your particular scenario and decide the right type of tool to suits your needs. Let’s get started.<\/p>\n\n\n\n

<\/a>1. Java Profiling Tools<\/h2>\n\n\n\n

JVM Profiles offer a ton of raw data by tracking all method calls, allowing you to find CPU and memory consumption hotspots.<\/p>\n\n\n\n

A good scaling test is to set up an Apache JMeter<\/a> job to hit an endpoint you are developing a few thousand times while linked to a profiler. This allows you to spec out memory and CPU requirements for production.<\/p>\n\n\n\n

\"VisualVM
Screenshot of VisualVM CPU and Heap Size<\/figcaption><\/figure>\n\n\n\n

Pros<\/strong><\/h3>\n\n\n\n

Great for tracking down memory leaks<\/a>; the ability to manually run garbage collection<\/a> and then review memory consumption can easily shine a spotlight on classes and processes that are holding on to memory in error.<\/p>\n\n\n\n

Cons<\/strong><\/h3>\n\n\n\n

Requires a direct connection to the monitored JVM; this ends up limiting usage to development environments in most cases. (Note: some profilers can work off thread and memory dumps in a limited fashion.)<\/p>\n\n\n\n

Popular Tools<\/strong> <\/h3>\n\n\n\n

VisualVM<\/a>, JProfiler<\/a>, YourKit<\/a> and Java Mission Control<\/a>.<\/p>\n\n\n\n

<\/a>2. Tracing Java Web Requests and Transactions<\/h2>\n\n\n\n

Standard java profiling tools are focused on the performance of all methods across the entire application. These tools are focused on the performance of individual web requests or transactions.<\/p>\n\n\n\n

Prefix<\/a><\/strong> <\/h3>\n\n\n\n

Prefix provides deep level performance details about your app, including ORM calls with generated SQL, SOAP\/REST API calls, and trace details from the most commonly used third-party libraries and frameworks.<\/p>\n\n\n\n

XRebel <\/strong><\/h3>\n\n\n\n

XRebel is set up using a Java Agent on your web application’s container and provides an overlay on your application that gives details about the current request.<\/p>\n\n\n\n

Tools like Prefix<\/a> can provide very detailed traces of what your code is doing:<\/p>\n\n\n\n

\"Prefix
Screenshot of Prefix web request trace<\/figcaption><\/figure>\n\n\n\n

Pros<\/strong><\/h3>\n\n\n\n

These tools give order to the vast amount of data available in a JVM profiler<\/a>. By helping you follow the flow of a request, you can see what types of method calls are responsible for your response time.<\/p>\n\n\n\n

Cons<\/strong><\/h3>\n\n\n\n

Designed for the development cycle only. QA and Production environments will require an APM<\/a> solution.<\/p>\n\n\n\n

<\/a>3. Java Performance Monitoring With an APM<\/h2>\n\n\n\n
\"\"<\/figure>\n\n\n\n

Application performance management (APM) tools take on the task of tracking all requests on a production system. <\/p>\n\n\n\n

The trick with these profilers is to provide the right information in a smart way so as not to impact production performance. <\/p>\n\n\n\n

This is done by aggregating timing statistics and sampling traces. This gives you method level visibility to your code that is running in production.<\/p>\n\n\n\n

\"Retrace
Screenshot: Retrace Action Overview<\/em><\/figcaption><\/figure>\n\n\n\n

Pros<\/strong><\/h3>\n\n\n\n

The ability to monitor your most critical environment: Production. The key to perfecting Java performance monitoring is to identify issues before going into production<\/a> by monitoring QA\/Staging. Debug production live by analyzing traces and exceptions. Aggregate summaries to see highly used requests to help focus development time.<\/p>\n\n\n\n

Cons<\/strong><\/h3>\n\n\n\n

Typically expensive to run on all QA\/Staging and Production servers. Some tools lack support for async queries or are not tuned properly and slow down your application.<\/p>\n\n\n\n

Note: <\/strong>Some providers, including Stackify Retrace<\/a>, provide free trials that can be used to help identify immediate problems.<\/p>\n\n\n\n

\"Compare<\/a><\/figure>\n\n\n\n
\"Compare<\/a><\/figure>\n\n\n\n

4. Java Performance Monitoring<\/mark> With Real User Monitoring (RUM)<\/h2>\n\n\n\n

It’s not uncommon for web apps to be very client-side heavy. Therefore, providing an interactive experience can require a good deal of dependencies, such as Javascript\/CSS frameworks, web fonts and images.<\/p>\n\n\n\n

RUM<\/a> provides insight into your application’s dependencies by giving visibility to asset download and page rendering time.<\/p>\n\n\n\n

Some APM products include this as an additional feature. There are also standalone products, such as Google PageSpeed<\/a>.<\/p>\n\n\n\n

\"Google
Screenshot: Google PageSpeed Overview<\/em><\/figcaption><\/figure>\n\n\n\n

5. JVM Performance Metrics<\/h2>\n\n\n\n

The JVM provides a great deal of valuable information such as garbage collection, memory usage, and thread counts. This data is made available via JMX.<\/p>\n\n\n\n

\"JConsole
Screenshot: JConsole Monitoring Heap Memory Usage<\/em><\/figcaption><\/figure>\n\n\n\n

Stackify Retrace provides JVM metric monitoring via App Monitors<\/a> and automatically applies smart defaults based on the type of application discovered.<\/p>\n\n\n\n

\"Stackify
Screenshot of Stackify JVM smart default monitors<\/em><\/figcaption><\/figure>\n\n\n\n
\"Screenshot
Screenshot of Stackify Retrace JVM metric dashboard<\/em><\/figcaption><\/figure>\n\n\n\n

Pros<\/strong><\/h3>\n\n\n\n

Available in any application running on the JVM and easy to connect to with apps such as JConsole<\/a>.<\/p>\n\n\n\n

Cons<\/strong><\/h3>\n\n\n\n

Can be difficult to connect to in a staging and production environment. Aggregation and comparing data might be time-consuming. Stats are only gathered while the monitor is connected to the JVM.<\/p>\n\n\n\n

Read more<\/strong><\/h3>\n\n\n\n

Java Virtual Machine: Critical Metrics You Need to Track<\/a><\/p>\n\n\n\n

<\/a>6. Web Server (Apache\/Nginx) Access Logs<\/h2>\n\n\n\n

If you have Apache or Nginx proxying requests to your Java application server, you can monitor access logs. This is a quick way to see how long requests are taking. <\/p>\n\n\n\n

You can aggregate the access logs to see what the most popular\/fastest\/slowest endpoints are. Doing this via the command line can be time-consuming, though.<\/p>\n\n\n\n

For small datasets, you can use a desktop tool like Apache Viewer, but for staging and production environments, a hosted logging solution is ideal.<\/p>\n\n\n\n

Tracking Failed Requests <\/strong>is also very useful, which can be done by aggregating on HTTP Response Codes<\/a>.<\/p>\n\n\n\n

Pros<\/strong><\/h3>\n\n\n\n

Quick way to get some simple stats by tailing access logs, or\u2014if more info is needed\u2014push into a log analyzer.<\/p>\n\n\n\n

Cons<\/strong><\/h3>\n\n\n\n

Doesn\u2019t give you any details as to why the request took as long as it did. Lack of POST data and response content that could help point you to the cause of a performance issue.<\/p>\n\n\n\n

Desktop Tools<\/strong><\/h3>\n\n\n\n

AWStats<\/a> and Apache Viewer<\/a><\/p>\n\n\n\n

Hosted Tools<\/strong><\/h3>\n\n\n\n

ELK stack<\/a>, Stackify<\/a>, Splunk<\/a>, LogEntries<\/a><\/p>\n\n\n\n

Read more<\/strong><\/h3>\n\n\n\n

13 Ways to Tail a Log File on Windows & Linux<\/a><\/p>\n\n\n\n

<\/a>7. Tracking All Java Exceptions<\/h2>\n\n\n\n

One of the biggest causes of performance problems can be application exceptions. <\/p>\n\n\n\n

When an exception is thrown, it causes the thread to pause while the stack trace is collected. Even handled exceptions<\/a> that seem innocent can cause huge performance bottlenecks under heavy server load. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

It is important to aggregate and monitor all of your exceptions to find critical problems, new errors, and monitor error rates over time.<\/p>\n\n\n\n

Pros<\/strong><\/h3>\n\n\n\n

Easy to setup if you are using a logging framework such as Log4j<\/a> or Logback<\/a>.<\/p>\n\n\n\n

Cons<\/strong><\/h3>\n\n\n\n

None<\/p>\n\n\n\n

Popular Tools<\/strong><\/h3>\n\n\n\n

APM providers, Raygun, Stackify<\/a><\/p>\n\n\n\n

Read more<\/strong><\/h3>\n\n\n\n

How GWB Found Hidden Exceptions and Application Performance Problems<\/a><\/p>\n\n\n\n

8. Monitoring Java Exceptions<\/h2>\n\n\n\n

When trying to improve an app’s performance, you often need not simulate requests from users, but to instead monitor its actual operation. <\/p>\n\n\n\n

By monitoring JavaEE Servers in both production and QA environments, you become able to make decisions based on trends, before problems become too severe. <\/p>\n\n\n\n

You could also find out the causes of response times, implementing optimizations based on such times.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

JavaMelody<\/a> is an example of a tool that can help you perform environment monitoring.<\/p>\n\n\n\n

<\/a>9. Memory Analysis<\/h2>\n\n\n\n

Application memory analysis after a crash can help with identifying the cause of a memory leak<\/a>. You can instruct the JVM to dump the heap on an OutOfMemoryError<\/a> exception by adding the following argument to the JVM:<\/p>\n\n\n\n

-XX:+HeapDumpOnOutOfMemoryError<\/p>\n\n\n\n

The heap dump file can be loaded into an analyzer: Eclipse MAT<\/a>. You can dive into the Overview or Leaks Suspects reports to help identify the cause of the memory exception.<\/p>\n\n\n\n

\"Eclipse
Screenshot of Eclipse MAT: Biggest Objects by Retained Size<\/em><\/figcaption><\/figure>\n\n\n\n

<\/a>Boost Your Application’s Performance<\/h2>\n\n\n\n

The big takeaway is that Java performance monitoring<\/a> is easier than ever with all these tools. <\/p>\n\n\n\n

Don’t be overwhelmed by all the things you should be doing. Start with the low hanging fruit first, like exception tracking<\/a>. <\/p>\n\n\n\n

It is really good to at least know what options are available to you, and I hope you found this list helpful.<\/p>\n\n\n\n

\n<\/a><\/span>