public class LocalDirsHandlerService
extends org.apache.hadoop.service.AbstractService
| Constructor and Description |
|---|
LocalDirsHandlerService() |
LocalDirsHandlerService(NodeManagerMetrics nodeManagerMetrics) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
areDisksHealthy()
The minimum fraction of number of disks needed to be healthy for a node to
be considered healthy in terms of disks is configured using
YarnConfiguration.NM_MIN_HEALTHY_DISKS_FRACTION, with a default
value of YarnConfiguration.DEFAULT_NM_MIN_HEALTHY_DISKS_FRACTION. |
void |
deregisterLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
void |
deregisterLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
Iterable<org.apache.hadoop.fs.Path> |
getAllLocalPathsForRead(String pathStr) |
List<String> |
getDiskFullLocalDirs() |
List<String> |
getDiskFullLogDirs() |
String |
getDisksHealthReport(boolean listGoodDirs)
Function to generate a report on the state of the disks.
|
long |
getLastDisksCheckTime() |
List<String> |
getLocalDirs() |
List<String> |
getLocalDirsForCleanup()
Function to get the local dirs which should be considered when cleaning up
resources.
|
List<String> |
getLocalDirsForRead()
Function to get the local dirs which should be considered for reading
existing files on disk.
|
org.apache.hadoop.fs.Path |
getLocalPathForRead(String pathStr) |
org.apache.hadoop.fs.Path |
getLocalPathForWrite(String pathStr) |
org.apache.hadoop.fs.Path |
getLocalPathForWrite(String pathStr,
long size,
boolean checkWrite) |
List<String> |
getLogDirs() |
List<String> |
getLogDirsForCleanup()
Function to get the log dirs which should be considered when cleaning up
resources.
|
List<String> |
getLogDirsForRead()
Function to get the log dirs which should be considered for reading
existing files on disk.
|
org.apache.hadoop.fs.Path |
getLogPathForWrite(String pathStr,
boolean checkWrite) |
org.apache.hadoop.fs.Path |
getLogPathToRead(String pathStr) |
boolean |
isGoodLocalDir(String path) |
boolean |
isGoodLogDir(String path) |
void |
registerLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
void |
registerLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener) |
protected void |
serviceInit(org.apache.hadoop.conf.Configuration config)
Method which initializes the timertask and its interval time.
|
protected void |
serviceStart()
Method used to start the disk health monitoring, if enabled.
|
protected void |
serviceStop()
Method used to terminate the disk health monitoring service.
|
protected void |
updateMetrics() |
static String[] |
validatePaths(String[] paths) |
close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStoppublic LocalDirsHandlerService()
public LocalDirsHandlerService(NodeManagerMetrics nodeManagerMetrics)
protected void serviceInit(org.apache.hadoop.conf.Configuration config)
throws Exception
serviceInit in class org.apache.hadoop.service.AbstractServiceExceptionprotected void serviceStart()
throws Exception
serviceStart in class org.apache.hadoop.service.AbstractServiceExceptionprotected void serviceStop()
throws Exception
serviceStop in class org.apache.hadoop.service.AbstractServiceExceptionpublic void registerLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public void registerLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public void deregisterLocalDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public void deregisterLogDirsChangeListener(DirectoryCollection.DirsChangeListener listener)
public List<String> getLocalDirs()
public List<String> getLogDirs()
public List<String> getDiskFullLocalDirs()
public List<String> getDiskFullLogDirs()
public List<String> getLocalDirsForRead()
public List<String> getLocalDirsForCleanup()
public List<String> getLogDirsForRead()
public List<String> getLogDirsForCleanup()
public String getDisksHealthReport(boolean listGoodDirs)
listGoodDirs - flag to determine whether the report should report the state of
good dirs or failed dirspublic boolean areDisksHealthy()
YarnConfiguration.NM_MIN_HEALTHY_DISKS_FRACTION, with a default
value of YarnConfiguration.DEFAULT_NM_MIN_HEALTHY_DISKS_FRACTION.public long getLastDisksCheckTime()
public boolean isGoodLocalDir(String path)
public boolean isGoodLogDir(String path)
public org.apache.hadoop.fs.Path getLocalPathForWrite(String pathStr) throws IOException
IOExceptionpublic org.apache.hadoop.fs.Path getLocalPathForWrite(String pathStr, long size, boolean checkWrite) throws IOException
IOExceptionpublic org.apache.hadoop.fs.Path getLocalPathForRead(String pathStr) throws IOException
IOExceptionpublic Iterable<org.apache.hadoop.fs.Path> getAllLocalPathsForRead(String pathStr) throws IOException
IOExceptionpublic org.apache.hadoop.fs.Path getLogPathForWrite(String pathStr, boolean checkWrite) throws IOException
IOExceptionpublic org.apache.hadoop.fs.Path getLogPathToRead(String pathStr) throws IOException
IOExceptionprotected void updateMetrics()
Copyright © 2008–2022 Apache Software Foundation. All rights reserved.