403在使用Hadoop时创建文件.WebHDFSClient,虽然能够在HDFS中创建文件夹
本文关键字:创建 HDFS 文件夹 WebHDFSClient Hadoop 文件 | 更新日期: 2023-09-27 17:52:38
此代码一直工作到创建文件夹,然后无法创建文件并抛出403。我是不是遗漏了一些验证的东西。我是Hadoop的新手,正在尝试学习hdInsight。
private static void uploadFile()
{
//set variables
string srcFileName = @"./prime/in/integers.txt";
string destFolderName = @"/prime/in";
string destFileName = @"integers.txt";
string outputFolderName= @"/prime/out";
//connect to hadoop cluster
Uri myUri = new Uri("http://DXPZN72-LP:50070");
string userName = "hadoop";
WebHDFSClient myClient = new WebHDFSClient(myUri, userName);
//drop destination directory (if exists)
myClient.DeleteDirectory(destFolderName, true).Wait();
//create destination directory
myClient.CreateDirectory(destFolderName).Wait();
//create outputFolderName directory
myClient.CreateDirectory(outputFolderName).Wait();
//load file to destination directory
var res= myClient.CreateFile(srcFileName, "/" +destFileName);
res.Wait();
//list file contents of destination directory
Console.WriteLine();
Console.WriteLine("Contents of " +destFolderName);
myClient.GetDirectoryStatus(destFolderName).ContinueWith(
ds => ds.Result.Files.ToList().ForEach(
f => Console.WriteLine("t" +f.PathSuffix)
));
//keep command window open until user presses enter
Console.ReadLine();
}
发现需要重新启动的服务。虽然我可以创建文件夹,但是不能创建带有403的File .
我重新启动了我的机器,然后再试一次,问题消失了,我也可以创建文件了