Community

Blog Events Webinars Tutorials Forum
  1. Blog
  2. Events
  3. Webinars
  4. Tutorials
  5. Forum
Create Account
×
Community Blog Real-Time Java Logs Collection with Appender

Real-Time Java Logs Collection with Appender

In this article, we will introduce how to collect real-time java logs with Appender.

Java applications currently have two mainstream log collection solutions:

  1. Java programs flush logs to disks and use Logtail for real-time collection.
  2. Java programs directly configure the Appender provided by Log Service. When the program is running, logs are sent to Log Service in real time.

By using Appender, you can use Config to complete real-time log collection easily without changing any code.

You can integrate Appender by performing the configuration steps of aliyun-log-log4j-appender.

The contents of the configuration file log4j.properties are as follows:

log4j.rootLogger=WARN,loghub

log4j.appender.loghub=com.aliyun.openservices.log.log4j.LoghubAppender

# Log Service project name (required parameter)
log4j.appender.loghub.projectName=[your project]
# Log Service LogStore name (required parameter)
log4j.appender.loghub.logstore=[your logstore]
#Log Service HTTP address (required parameter)
log4j.appender.loghub.endpoint=[your project endpoint]
# User identity (required parameter)
log4j.appender.loghub.accessKeyId=[your accesskey id]
log4j.appender.loghub.accessKey=[your accesskey]

After configuring the Appender as described in the previous step, the logs produced by Java applications are automatically sent to Log Service. You can use LogSearch/Analytics to query and analyze these logs in real time. For details, please go to 3 Ways to Migrate Java Logs to the Cloud: Log4J, LogBack, and Producer Lib.

Related Blog Posts

Alibaba Cloud LOG Java Producer - A Powerful Tool to Migrate Logs to the Cloud

Logs are ubiquitous. As a carrier that records changes in the world, logs are widely used in many fields, such as marketing, research and development, operation, security, BI, and auditing.

Alibaba Log Service is an all-in-one service platform for log data. Its core component LogHub has become an infrastructure of big data processing, especially real-time data processing, by virtue of outstanding features such as high throughput, low latency, and auto-scaling. Jobs running on big data computing engines such as Flink, Spark, and Storm write data processing results or intermediate results to LogHub in real time. With data from LogHub, downstream systems are able to provide many services such as query analysis, monitoring alarms, machine learning, and iterative calculation. The LogHub big data processing architecture is provided in the following figure.

How to Use Alibaba Cloud LOG Java Producer

This article will show you how to use Alibaba Cloud's LOG Java Producer, an easy-to-use, highly configurable Java library that helps you send data to Log Service.

The Alibaba Cloud LOG Java Producer is high performance write LogHub library that is designed for Java applications running in big data and high concurrency scenarios. In comparison with using APIs or SDKs, using Alibaba Cloud LOG Java Producer (Producer) has many advantages, such as high performance, isolated computing and I/O logic, and controllable resource usage. To understand the features and mechanisms of the Producer, see the article Alibaba Cloud LOG Java Producer - A powerful tool to migrate logs to the cloud. This article will focus on the use of the Producer.

Related Documentation

How do I collect various formats of logs in complete regular mode?

The complete regular mode requires format consistency among all logs. However, some logs may contain content in multiple formats. In this case, you can use the Schema-On-Write or Schema-On-Read mode to process the logs.

For example, a Java log is a program log that contains both correct information and error information (such as information about abnormal stacks), including:

  1. Multi-line WARNING logs
  2. Simple text INFO logs
  3. Key-value DEBUG logs

Log4j Appender

Log4j is an open source logging framework developed by Apache. You can use Log4j to print logs to a console, file, Graphical User Interface (GUI) component, socket server, NT kernel logger, or Unix syslog daemon. You can define the output format of each log entry. You can also define the level of each log entry to achieve fine-grained control over the generation of logs.

log appender java log4j configuration in java java logs
0 0 0
Share on

Read previous post:

Alibaba Kicks Off 2019 11.11 Global Shopping Festival with New Initiatives

Read next post:

Creating a Robust Cloud-Based Database for Fintech, E-Commerce, and Gaming

Alibaba Clouder

2,599 posts | 762 followers

You may also like

Comments

Alibaba Clouder

2,599 posts | 762 followers

Related Products

More Posts by Alibaba Clouder

See All