温馨提示×

温馨提示×

您好,登录后才能下订单哦!

密码登录×
登录注册×
其他方式登录
点击 登录注册 即表示同意《亿速云用户服务条款》

Flume如何安装

发布时间:2021-11-16 10:25:49 来源:亿速云 阅读:138 作者:小新 栏目:云计算

这篇文章主要为大家展示了“Flume如何安装”,内容简而易懂,条理清晰,希望能够帮助大家解决疑惑,下面让小编带领大家一起研究并学习一下“Flume如何安装”这篇文章吧。

一、下载/解压缩

[root@hadoop0 opt]# wget http://mirror.bit.edu.cn/apache/flume/1.6.0/apache-flume-1.6.0-bin.tar.gz

--1999-05-08 19:02:36--  http://mirror.bit.edu.cn/apache/flume/1.6.0/apache-flume-1.6.0-bin.tar.gz

Resolving mirror.bit.edu.cn... 114.247.56.117

Connecting to mirror.bit.edu.cn|114.247.56.117|:80... connected.

HTTP request sent, awaiting response... 200 OK

Length: 52550402 (50M) [application/octet-stream]

Saving to: apache-flume-1.6.0-bin.tar.gz

100%[===========================>] 52,550,402   621K/s   in 1m 41s  

1999-05-08 19:04:17 (507 KB/s) - apache-flume-1.6.0-bin.tar.gz saved [52550402/52550402]

[root@hadoop0 opt]# tar -zxvf apache-flume-1.6.0-bin.tar.gz

[root@hadoop0 opt]# cd apache-flume-1.6.0-bin

[root@hadoop0 apache-flume-1.6.0-bin]# ./bin/flume-ng help

Usage: ./bin/flume-ng <command> [options]...

commands:

  help                      display this help text

  agent                     run a Flume agent

  avro-client               run an avro Flume client

  version                   show Flume version info

global options:

  --conf,-c <conf>          use configs in <conf> directory

  --classpath,-C <cp>       append to the classpath

  --dryrun,-d               do not actually start Flume, just print the command

  --plugins-path <dirs>     colon-separated list of plugins.d directories. See the

                            plugins.d section in the user guide for more details.

                            Default: $FLUME_HOME/plugins.d

  -Dproperty=value          sets a Java system property value

  -Xproperty=value          sets a Java -X option

agent options:

  --name,-n <name>          the name of this agent (required)

  --conf-file,-f <file>     specify a config file (required if -z missing)

  --zkConnString,-z <str>   specify the ZooKeeper connection to use (required if -f missing)

  --zkBasePath,-p <path>    specify the base path in ZooKeeper for agent configs

  --no-reload-conf          do not reload config file if changed

  --help,-h                 display help text

avro-client options:

  --rpcProps,-P <file>   RPC client properties file with server connection params

  --host,-H <host>       hostname to which events will be sent

  --port,-p <port>       port of the avro source

  --dirname <dir>        directory to stream to avro source

  --filename,-F <file>   text file to stream to avro source (default: std input)

  --headerFile,-R <file> File containing event headers as key/value pairs on each new line

  --help,-h              display help text

  Either --rpcProps or both --host and --port must be specified.

Note that if <conf> directory is specified, then it is always included first

in the classpath.

二、增加配置文件

[root@hadoop0 apache-flume-1.6.0-bin]# vi conf/hw.conf

agent.sources=s1

agent.channels=c1

agent.sinks=k1

agent.sources.s1.type=netcat

agent.sources.s1.channels=c1

agent.sources.s1.bind=192.168.1.111

agent.sources.s1.port=12345

agent.channels.c1.type=memory

agent.sinks.k1.type=logger

agent.sinks.k1.channel=c1

三、启动、验证

[root@hadoop0 apache-flume-1.6.0-bin]

# ./bin/flume-ng agent -n agent  -c conf -f conf/hw.conf -Dflume.root.logger=INFO,console

[root@hadoop0 ~]# netstat -tnpl

Active Internet connections (only servers)

Proto Recv-Q Send-Q Local Address               Foreign Address             State       PID/Program name   

tcp        0      0 0.0.0.0:9447                0.0.0.0:*                   LISTEN      1349/rpc.statd      

tcp        0      0 0.0.0.0:111                 0.0.0.0:*                   LISTEN      1304/rpcbind        

tcp        0      0 0.0.0.0:22                  0.0.0.0:*                   LISTEN      1538/sshd           

tcp        0      0 127.0.0.1:631               0.0.0.0:*                   LISTEN      1382/cupsd          

tcp        0      0 127.0.0.1:25                0.0.0.0:*                   LISTEN      1618/master         

tcp        0      0 :::111                      :::*                        LISTEN      1304/rpcbind        

tcp        0      0 :::13683                    :::*                        LISTEN      1349/rpc.statd      

tcp        0      0 :::22                       :::*                        LISTEN      1538/sshd           

tcp        0      0 ::1:631                     :::*                        LISTEN      1382/cupsd          

tcp        0      0 ::1:25                      :::*                        LISTEN      1618/master         

[root@hadoop0 ~]# nc -l 12345

nc: Address already in use

[root@hadoop0 ~]# nc localhost  12345

[root@hadoop0 ~]# nc 192.168.1.111  12345

sdfsdfdsf

OK

sdfsdfsdf

OK

gaojingsong

OK

whomai

OK

四、验证结果


Flume如何安装
 


Flume如何安装

以上是“Flume如何安装”这篇文章的所有内容,感谢各位的阅读!相信大家都有了一定的了解,希望分享的内容对大家有所帮助,如果还想学习更多知识,欢迎关注亿速云行业资讯频道!

向AI问一下细节

免责声明:本站发布的内容(图片、视频和文字)以原创、转载和分享为主,文章观点不代表本网站立场,如果涉及侵权请联系站长邮箱:is@yisu.com进行举报,并提供相关证据,一经查实,将立刻删除涉嫌侵权内容。

AI