This article introduces how to efficiently view Hadoop logs in Debian system. Hadoop's log aggregation function centrally stores the logs of each node for easy management. The following steps will guide you on how to view these logs:
Step 1: Make sure log aggregation is enabled
First, confirm that log aggregation is enabled for all nodes in the Hadoop cluster. This is usually configured in yarn-site.xml
configuration file:
<property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property> <property> <name>yarn.log-aggregation.retain-seconds</name> <value>172800</value> </property> <property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/tmp/logs</value> </property> <property> <name>yarn.nodemanager.remote-app-log-dir-suffix</name> <value>logs</value> </property> <property> <name>yarn.log.server.url</name> <value>http://hadoop-node0:19888/jobhistory/logs</value> </property>
Step 2: Access logs through the Web UI
After log aggregation, you can view the logs through Hadoop's ResourceManager Web UI or the Job History Server Web UI:
- ResourceManager Web UI: The default address is
http://<resourcemanager-hostname> :8088/cluster/apps/FINISHED</resourcemanager-hostname>
. - Job History Server Web UI: The default address is
http://<jobhistory-server-hostname> :19888/jobhistory</jobhistory-server-hostname>
.
Step 3: Use the command line tool to view the log
If you need to read the logs directly from HDFS, you can use the hdfs dfs
command:
hdfs dfs -cat /path/to/logs/*
Step 4: Use a text editor to view the log
You can open and view log files using any text editor (such as nano
, vim
):
sudo nano /path/to/logs/application-<application-id> -container-<container-id> .log</container-id></application-id>
Note that log file paths and URLs may vary depending on Hadoop cluster configuration. Please refer to your Hadoop cluster configuration file for the exact path.
The above is the detailed content of How to view Debian Hadoop logs. For more information, please follow other related articles on the PHP Chinese website!

Hot AI Tools

Undress AI Tool
Undress images for free

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics









Are you exploring the infinite possibilities of digital currency? Want a safe and reliable tool to help you roam in this opportunity-filled market? A powerful virtual currency app is your indispensable partner. It allows you to easily grasp the pulse of the market and manage assets anytime, anywhere.

Dogecoin (DOGE) was born in an interesting joke, and its logo is a cute Shiba Inu. After years of development, it has become a well-known currency in the digital currency field with a large community base. Due to its high price volatility, many followers need a tool that can view its price dynamics in real time.

In the ever-changing world of digital currency, seizing every investment opportunity is crucial. Having a powerful, safe and reliable digital currency platform app is like having an all-weather smart investment assistant. It not only allows you to easily track real-time market trends and in-depth historical data of mainstream virtual currencies around the world, but also helps you quickly complete transactions in price fluctuations and seize market opportunities. Say goodbye to the tedious operations and welcome the new era of one-stop digital asset management!

SOL coins, the native token of the Solana platform, are based on a high-performance public chain known for their high speed and low transaction costs. Solana aims to provide a scalable, secure and efficient infrastructure for decentralized applications (DApps) and cryptocurrencies.

Ethereum is not just a digital currency, it is also a global, decentralized open source blockchain platform known for its innovative smart contract capabilities. Its native cryptocurrency is Ether (ETH). Due to its widespread use in the fields of decentralized finance (DeFi) and non-fungible tokens (NFT), Ethereum's price trends and K-line analysis have become the focus of global investors and technology enthusiasts.

Dogecoin, referred to as DOGE, was born as an interesting joke, but with its strong community consensus and unique cultural attributes, it has become an indispensable member of the digital currency market. For investors who are paying attention to Dogecoin price fluctuations, it is crucial to have an app that can view K-line dynamics in real time.

Dogecoin, the English name Dogecoin, referred to as DOGE, was born on December 6, 2013. It is an open source peer-to-peer cryptocurrency based on the Scrypt algorithm. Initially, it was just created as a funny "joke" or "meme coins" with its signature being a cute Japanese Shiba Inu. However, thanks to its active community culture and frequent social media exposure, Dogecoin has gradually developed into one of the world's well-known digital currencies, attracting the attention of a large number of investors.

With the changing trends of the digital currency market, it is particularly important to have a safe and efficient tool to grasp the market and conduct transactions in real time. Whether you are a veteran player or a beginner, this powerful digital currency app can meet your needs. It can not only view the real-time and historical prices of various digital currencies, but also conduct various digital currency transactions to help you gain the upper hand in the digital world.
