大数据全系列 教程
1869个小节阅读:467.9k
408考研
JAVA全系列 教程
面向对象的程序设计语言
Python全系列 教程
Python3.x版本,未来主流的版本
人工智能 教程
顺势而为,AI创新未来
大厂算法 教程
算法,程序员自我提升必经之路
C++ 教程
一门通用计算机编程语言
微服务 教程
目前业界流行的框架组合
web前端全系列 教程
通向WEB技术世界的钥匙
大数据全系列 教程
站在云端操控万千数据
AIGC全能工具班
A A
White Night
###3.9.2 单分区
建表脚本:
xxxxxxxxxx
create table person5(
id int comment "唯一标识id",
name string comment "名称",
likes array<string> comment "爱好",
address map<string,string> comment "地址"
)
partitioned by(age int)
row format delimited
fields terminated by ","
collection items terminated by "-"
map keys terminated by ":"
lines terminated by "\n";
创建表,并查看表信息:
xxxxxxxxxx
hive> create table person5(
> id int comment "唯一标识id",
> name string comment "名称",
> likes array<string> comment "爱好",
> address map<string,string> comment "地址"
> )
> partitioned by(age int)
> row format delimited
> fields terminated by ","
> collection items terminated by "-"
> map keys terminated by ":"
> lines terminated by "\n";
OK
Time taken: 0.306 seconds
hive> desc formatted person5;
OK
# col_name data_type comment
id int 唯一标识id
name string 名称
likes array<string> 爱好
address map<string,string> 地址
# Partition Information 分区信息
# col_name data_type comment
age int
注意分区字段不能出现在脚本的table后面的小括号中。
添加数据:
xxxxxxxxxx
hive> load data local inpath '/root/data/person.txt' into table person5;
Query ID = root_20211111203223_7dd1d883-7d5d-4d71-bd0e-dfb74c08da40
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
......
Loading data to table default.person5 partition (age=null)
#hdfs路径:person5/age=__HIVE_DEFAULT_PARTITION__
添加数据是一定要指定对应的分区数据。
xxxxxxxxxx
hive> load data local inpath '/root/data/person.txt' into table person5 partition(age=10);
Loading data to table default.person5 partition (age=10)
OK
Time taken: 2.124 seconds
hive> select * from person5;
OK
1 小明1 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
2 小明2 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
3 小明3 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
4 小明4 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
5 小明5 ["lol","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
6 小明6 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
7 小明7 ["lol","book"] {"beijing":"xisanqi","shanghai":"pudong"} 10
8 小明8 ["lol","book"] {"beijing":"xisanqi","shanghai":"pudong"} 10
9 小明9 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
hive> load data local inpath '/root/data/person.txt' into table person5 partition(age=20);
Loading data to table default.person5 partition (age=20)
OK
Time taken: 1.123 seconds
hive> select * from person5;
OK
1 小明1 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
2 小明2 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
3 小明3 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
4 小明4 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
5 小明5 ["lol","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
6 小明6 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
7 小明7 ["lol","book"] {"beijing":"xisanqi","shanghai":"pudong"} 10
8 小明8 ["lol","book"] {"beijing":"xisanqi","shanghai":"pudong"} 10
9 小明9 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 10
1 小明1 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 20
2 小明2 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 20
3 小明3 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 20
4 小明4 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 20
5 小明5 ["lol","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 20
6 小明6 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 20
7 小明7 ["lol","book"] {"beijing":"xisanqi","shanghai":"pudong"} 20
8 小明8 ["lol","book"] {"beijing":"xisanqi","shanghai":"pudong"} 20
9 小明9 ["lol","book","movie"] {"beijing":"xisanqi","shanghai":"pudong"} 20