Package org.apache.storm.assignments
Class InMemoryAssignmentBackend
- java.lang.Object
-
- org.apache.storm.assignments.InMemoryAssignmentBackend
-
- All Implemented Interfaces:
AutoCloseable,ILocalAssignmentsBackend
public class InMemoryAssignmentBackend extends Object implements ILocalAssignmentsBackend
An assignment backend which will keep all assignments and id-info in memory. Only used if no backend is specified internal.About thread safe: idToAssignment,idToName,nameToId are all memory cache in nimbus local, for
- idToAssignment: nimbus will modify it and supervisors will sync it at fixed interval, so the assignments would come to eventual consistency.
- idToName: storm submitting/killing is guarded by the same lock, a
ConcurrentHashMapis ok. - nameToId: same as idToName.
-
-
Constructor Summary
Constructors Constructor Description InMemoryAssignmentBackend()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description List<String>assignments()List all the storm runtime ids of local assignments.Map<String,Assignment>assignmentsInfo()Get all the local assignments of local state.voidclearStateForStorm(String stormId)Clear all the state for a storm.voidclose()Function to release resource.voiddeleteStormId(String stormName)Delete a local cache of stormId which is mapped to a specific storm name.AssignmentgetAssignment(String stormId)Get assignment asAssignmentfor a storm.StringgetStormId(String stormName)Get storm runtime id from local.booleanisSynchronized()Decide if the assignments is synchronized from remote state-store.voidkeepOrUpdateAssignment(String stormId, Assignment assignment)Keep a storm assignment to local state or update old assignment.voidkeepStormId(String stormName, String stormId)Keep a mapping storm-name -> storm-id to local state.voidprepare(Map conf)Initial function for creating backend.voidremoveAssignment(String stormId)voidsetSynchronized()Mark this backend as synchronized when sync work is done.voidsyncRemoteAssignments(Map<String,byte[]> remote)Sync remote assignments to local, if remote is null, we will sync it from zk.voidsyncRemoteIds(Map<String,String> remote)Sync remote storm ids to local, will just used for nimbus.
-
-
-
Method Detail
-
isSynchronized
public boolean isSynchronized()
Description copied from interface:ILocalAssignmentsBackendDecide if the assignments is synchronized from remote state-store.- Specified by:
isSynchronizedin interfaceILocalAssignmentsBackend
-
setSynchronized
public void setSynchronized()
Description copied from interface:ILocalAssignmentsBackendMark this backend as synchronized when sync work is done.- Specified by:
setSynchronizedin interfaceILocalAssignmentsBackend
-
prepare
public void prepare(Map conf)
Description copied from interface:ILocalAssignmentsBackendInitial function for creating backend.- Specified by:
preparein interfaceILocalAssignmentsBackend- Parameters:
conf- config
-
keepOrUpdateAssignment
public void keepOrUpdateAssignment(String stormId, Assignment assignment)
Description copied from interface:ILocalAssignmentsBackendKeep a storm assignment to local state or update old assignment.- Specified by:
keepOrUpdateAssignmentin interfaceILocalAssignmentsBackend- Parameters:
stormId- storm runtime idassignment- assignment as thrift
-
getAssignment
public Assignment getAssignment(String stormId)
Description copied from interface:ILocalAssignmentsBackendGet assignment asAssignmentfor a storm.- Specified by:
getAssignmentin interfaceILocalAssignmentsBackend- Parameters:
stormId- storm runtime id- Returns:
- assignment
-
removeAssignment
public void removeAssignment(String stormId)
- Specified by:
removeAssignmentin interfaceILocalAssignmentsBackend
-
assignments
public List<String> assignments()
Description copied from interface:ILocalAssignmentsBackendList all the storm runtime ids of local assignments.- Specified by:
assignmentsin interfaceILocalAssignmentsBackend- Returns:
- a list of storm ids
-
assignmentsInfo
public Map<String,Assignment> assignmentsInfo()
Description copied from interface:ILocalAssignmentsBackendGet all the local assignments of local state.- Specified by:
assignmentsInfoin interfaceILocalAssignmentsBackend- Returns:
- mapping of storm-id -> assignment
-
syncRemoteAssignments
public void syncRemoteAssignments(Map<String,byte[]> remote)
Description copied from interface:ILocalAssignmentsBackendSync remote assignments to local, if remote is null, we will sync it from zk.- Specified by:
syncRemoteAssignmentsin interfaceILocalAssignmentsBackend- Parameters:
remote- specific remote assignments, if it is null, it will sync from zookeeper[only used for nimbus]
-
keepStormId
public void keepStormId(String stormName, String stormId)
Description copied from interface:ILocalAssignmentsBackendKeep a mapping storm-name -> storm-id to local state.- Specified by:
keepStormIdin interfaceILocalAssignmentsBackend- Parameters:
stormName- storm namestormId- storm runtime id
-
getStormId
public String getStormId(String stormName)
Description copied from interface:ILocalAssignmentsBackendGet storm runtime id from local.- Specified by:
getStormIdin interfaceILocalAssignmentsBackend- Parameters:
stormName- name of a storm- Returns:
- runtime storm id
-
syncRemoteIds
public void syncRemoteIds(Map<String,String> remote)
Description copied from interface:ILocalAssignmentsBackendSync remote storm ids to local, will just used for nimbus.- Specified by:
syncRemoteIdsin interfaceILocalAssignmentsBackend- Parameters:
remote- remote ids from state store
-
deleteStormId
public void deleteStormId(String stormName)
Description copied from interface:ILocalAssignmentsBackendDelete a local cache of stormId which is mapped to a specific storm name.- Specified by:
deleteStormIdin interfaceILocalAssignmentsBackend- Parameters:
stormName- storm name
-
clearStateForStorm
public void clearStateForStorm(String stormId)
Description copied from interface:ILocalAssignmentsBackendClear all the state for a storm.- Specified by:
clearStateForStormin interfaceILocalAssignmentsBackend- Parameters:
stormId- storm id
-
close
public void close()
Description copied from interface:ILocalAssignmentsBackendFunction to release resource.- Specified by:
closein interfaceAutoCloseable- Specified by:
closein interfaceILocalAssignmentsBackend
-
-