Breaking News: Grepper is joining You.com. Read the official announcement!

Hadoop client library java code

Add Answer

Anjali Sharma answered on January 12, 2023 Popularity 1/10 Helpfulness 1/10

answer Hadoop client library java code

Hadoop client library java code

Comment

y. The code to list the contents of an arbitrary directory

provided on the command line

public class HdfsClient {
public static void main(String[] args) throws IOException {
if (args.length < 1) {
System.err.println("Please provide the HDFS path (hdfs://hosthdfs:port/path)");
return;
}
String hadoopConf = System.getProperty("hadoop.conf");
if (hadoopConf == null) {
System.err.println("Please provide the system property hadoop.conf");
return;
}
Configuration conf = new Configuration();
conf.addResource(new Path(hadoopConf + "/core-site.xml"));
conf.addResource(new Path(hadoopConf + "/hdfs-site.xml"));
conf.addResource(new Path(hadoopConf + "/mapred-site.xml"));
conf.set("fs.hdfs.impl", org.apache.hadoop.hdfs.DistributedFileSystem.class.getName ←-
());
conf.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName());
FileSystem fileSystem = FileSystem.get(conf);
RemoteIterator<LocatedFileStatus> iterator = fileSystem.listFiles(new Path(args[0]) ←-
, false);
while (iterator.hasNext()) {
LocatedFileStatus fileStatus = iterator.next();
Path path = fileStatus.getPath();
System.out.println(path);
}
}
}

https://github.com/alagrede/HdfsClient

Popularity 1/10 Helpfulness 1/10 Language java

Source: Grepper

Tags: client-library hadoop java

Link to this answer
Share Copy Link

Contributed on Jan 12 2023

Anjali Sharma

0 Answers Avg Quality 2/10

Hadoop client library java code

Contents

More Related Answers

Hadoop client library java code

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.