|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.hive.ql.plan.ListBucketingCtx
public class ListBucketingCtx
Context for list bucketing. It's created in SemanticAnalyzer.genFileSinkPlan(). It's used in FileSinkOperator.processOp(), merging files, alter table ...concatenate etc.
Constructor Summary | |
---|---|
ListBucketingCtx()
|
Method Summary | |
---|---|
int |
calculateListBucketingLevel()
Calculate list bucketing level. |
void |
calculateSkewedValueSubDirList()
Calculate skewed value subdirectory directory which is used in FileSinkOperator.java createKeyForStatsPublisher() For example, create table test skewed by (key, value) on (('484','val_484') stored as DIRECTORIES; after the method, skewedValuesDirNames will contain 2 elements: key=484/value=val_484 HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME/HIVE_LIST_BUCKETING_DEFAULT_DIR_NAME |
String |
getDefaultDirName()
|
String |
getDefaultKey()
|
Map<List<String>,String> |
getLbLocationMap()
|
List<SkewedColumnPositionPair> |
getRowSkewedIndex()
|
List<String> |
getSkewedColNames()
|
List<List<String>> |
getSkewedColValues()
|
List<String> |
getSkewedValuesDirNames()
|
boolean |
isSkewedStoredAsDir()
check if list bucketing is enabled. |
boolean |
isStoredAsSubDirectories()
|
void |
processRowSkewedIndex(RowSchema rowSch)
Match column in skewed column list and record position. |
void |
setDefaultDirName(String defaultDirName)
|
void |
setDefaultKey(String defaultKey)
|
void |
setLbLocationMap(Map<List<String>,String> lbLocationMap)
|
void |
setRowSkewedIndex(List<SkewedColumnPositionPair> rowSkewedIndex)
|
void |
setSkewedColNames(List<String> skewedColNames)
|
void |
setSkewedColValues(List<List<String>> skewedColValues)
|
void |
setSkewedValuesDirNames(List<String> skewedValuesDirNames)
|
void |
setStoredAsSubDirectories(boolean isStoredAsSubDirectories)
|
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public ListBucketingCtx()
Method Detail |
---|
public List<String> getSkewedColNames()
public void setSkewedColNames(List<String> skewedColNames)
skewedColNames
- the skewedColNames to setpublic List<List<String>> getSkewedColValues()
public void setSkewedColValues(List<List<String>> skewedColValues)
skewedColValues
- the skewedColValues to setpublic Map<List<String>,String> getLbLocationMap()
public void setLbLocationMap(Map<List<String>,String> lbLocationMap)
lbLocationMap
- the lbLocationMap to setpublic void processRowSkewedIndex(RowSchema rowSch)
FileSinkOperator
generateListBucketingDirName().
Note that skewed column name matches skewed value in order.
rowSch
- public void calculateSkewedValueSubDirList()
public boolean isStoredAsSubDirectories()
public void setStoredAsSubDirectories(boolean isStoredAsSubDirectories)
isStoredAsSubDirectories
- the isStoredAsSubDirectories to setpublic String getDefaultKey()
public void setDefaultKey(String defaultKey)
defaultKey
- the defaultKey to setpublic String getDefaultDirName()
public void setDefaultDirName(String defaultDirName)
defaultDirName
- the defaultDirName to setpublic boolean isSkewedStoredAsDir()
ctx
-
public int calculateListBucketingLevel()
ctx
-
public List<String> getSkewedValuesDirNames()
public void setSkewedValuesDirNames(List<String> skewedValuesDirNames)
skewedValuesDirNames
- the skewedValuesDirNames to setpublic List<SkewedColumnPositionPair> getRowSkewedIndex()
public void setRowSkewedIndex(List<SkewedColumnPositionPair> rowSkewedIndex)
rowSkewedIndex
- the rowSkewedIndex to set
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |