public class TokenizerPostCount extends Object implements TokenizerPost
| Constructor and Description |
|---|
TokenizerPostCount(org.apache.wink.json4j.JSONObject params,
int numIdCols,
int maxTokens,
boolean wideFormat) |
| Modifier and Type | Method and Description |
|---|---|
long |
getNumCols() |
long |
getNumRows(long inRows) |
Types.ValueType[] |
getOutSchema() |
FrameBlock |
tokenizePost(List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.DocumentToTokens> tl,
FrameBlock out) |
public TokenizerPostCount(org.apache.wink.json4j.JSONObject params,
int numIdCols,
int maxTokens,
boolean wideFormat)
throws org.apache.wink.json4j.JSONException
org.apache.wink.json4j.JSONExceptionpublic FrameBlock tokenizePost(List<org.apache.sysds.runtime.transform.tokenize.Tokenizer.DocumentToTokens> tl, FrameBlock out)
tokenizePost in interface TokenizerPostpublic Types.ValueType[] getOutSchema()
getOutSchema in interface TokenizerPostpublic long getNumRows(long inRows)
getNumRows in interface TokenizerPostpublic long getNumCols()
getNumCols in interface TokenizerPostCopyright © 2021 The Apache Software Foundation. All rights reserved.