七天网络

大家在查：紧迫感艾瑞斯迎面而 moored 弗瑞赠品海战设计成 tax evasion Rove

Hadoop

网络分布式计算；分布式计算平台；分布式文件系统

Hadoop

网络释义

Hadoop

分布式计算

-有分布式计算(Hadoop)经验者优先 5、搜索级研发工程师岗位描述 : -负责搜索相关业务的架构设计与开发 -负责搜索相关服务 …

分布式计算平台

b) 有大规模分布式计算平台（Hadoop）的使用和并行算法开发及应用经验； c) 优秀的沟通表达能力。

分布式文件系统

...多disk啊太crazy了是用来做数据仓库还是分布式文件系统（hadoop）了小可才疏学浅目前见识过40个的 780跑DB的

大数据

...服人456：从目前接触的技术来看，无论是虚拟机还是大数据(hadoop)都是在基于二层网络架构进行数据传输，一但出现跨网 …

云计算和大数据

摘要：英特尔CAS 2.0解决方案，在数据库/OLTP、虚拟化、云计算和大数据（Hadoop）应用场景中可带来显著的I/O和应用性 …

分布式并行处理框架

...的算法和相关理论（模式识别，人工智能） (2)熟知分布式并行处理框架（Hadoop），并具有...

例句：

If I'm a developer using Hadoop and want to look at a bit of data , it will let me run some reports against the file system .

如果我是个使用 Hadoop 的开发者，想要查看一些数据，那么就可以通过文件系统报表达成所愿。

As the hadoop-0. 20 is one of your primary interfaces to the Hadoop cluster , you 'll see this utility used quite a bit through this article.

因为 hadoop-0.20 是 Hadoop 集群的主要接口之一，您会看到本文中多次使用这个实用程序。

Now that I 've coded my map and reduce implementations , all that's left to do is link everything up into a Hadoop Job.

现在我已经对我的 map 和 reduce 实现进行了编码，接下来所要做的是将所有这一切链接到一个 HadoopJob 。

From this article, it's easy to see how Hadoop makes distributed computing simple for processing large datasets .

通过本文很容易看出 Hadoop 显著简化了处理大型数据集的分布式计算。

All that's needed is a representation of the data in a vector form that the Hadoop infrastructure can use .

所有这一切的需要就是用矢量格式表达 Hadoop 基础设施可以使用的数据。

Well, as you 've probably guessed, Hadoop makes that easy to do .

当然，您已经猜到了，Hadoop 可以轻松地做到。

But from the previous discussion , it's easy to see how Hadoop provides parallel processing of work.

但是，通过前面的讨论很容易看出 Hadoop 如何提供并行处理。

Not to be outdone , commercial Hadoop pioneer Cloudera announced an HDFS partnership of its own yesterday .

商业 Hadoop 的先驱 Cloudera 也不甘示弱，于昨天发布了自己的 HDFS 合作伙伴计划。

A key part of the announcement was that Yahoo would make available a Hadoop enabled super computing data center named M45.

该声明的关键是 Yahoo 将建立一个使用 Hadoop 的超级计算数据中心，名为 M45 。

Alas , there are several things that Hadoop does not do , at least when accessed through the MapReduce interface .

唉，有几件事情 Hadoop 也不做，至少在通过 MapReduce 访问接口。

Now you have set up the Hadoop Cluster on the cloud , and it's ready to run the MapReduce applications .

现在，已经在云中设置了 Hadoop 集群，该运行 MapReduce 应用程序了。

Since we are going to be connecting to the hadoop file system , we might as well test that as well.

因为我们要连接到 hadoop 文件系统，我们不妨测试。

One particularly handy aspect of Hadoop is that it handles the raw parsing of an input file , so that you can deal with one line at a time .

Hadoop 可以对输入文件进行原始解析，这一点特别有用，这样您就可以每次处理一行。

For all the other settings , keep the defaults or choose the same values as you did for the Hadoop Master node .

对于所有其他设置，保留其默认值或者选择与 HadoopMaster 节点相同的值。

It is assumed that the Hadoop slave node has been configured a priori in such a manner that it registers with the Hadoop master node .

这里假设 Hadoop 从节点已经在之前配置完成，也就是它已经注册到 Hadoop 主节点中。

Now that you have installed Hadoop and tested the basic interface to its file system , it 's time to test Hadoop in a real application .

既然已经安装了 Hadoop 并测试了文件系统的基本接口，现在就该在真实的应用程序中测试 Hadoop 了。

This article introduces you to the important configurable parameters of Hadoop and the method for analyzing and tuning performance .

本文介绍重要的 Hadoop 可配置参数以及分析和调优性能的方法。

That magically seems to work , indicating that we can , indeed, connect to another machine and run the hadoop commands .

魔法般的似乎工作，表明我们可以，事实上，连接到另一台机器上，运行 hadoop 命令。

The Hadoop runtime will split up the data (log files ) that needs to be processed and give each node in your cluster a chunk of data .

Hadoop 运行时将分割需要处理的数据（一些日志文件）并向您的集群中的每个节点分配一个数据块。

One irony of this code and the Hadoop framework is that the input files do not have to be in the same format .

一个讽刺，这段代码和 Hadoop 框架是输入文件不需要在相同的格式。

Hadoop is really designed to run in a distributed manner where it handles the coordination of various nodes running map and reduce .

Hadoop 的设计旨在以一种分布式方式运行，处理运行 map 和 reduce 的各个节点之间的协调性。

You can perform a couple of tests to ensure that Hadoop is up and running normally (at least the namenode).

可以通过几个检查确认 Hadoop （至少是 namenode ）已经启动并正常运行。

So over the past 2 weekends , I 've worked on a hobby project , which lets you turn your Hudson cluster into a Hadoop cluster.

所以在过去的两个周末里，我一直在从事一个业余爱好项目，这个项目可以把 Hudson 集群转化成 Hadoop 集群。

Run the clustering algorithm of choice using one of the many Hadoop-ready driver programs available in Mahout.

使用 Mahout 中可用的 Hadoop 就绪的驱动程序运行所选集群算法。

Open source software designed by IBM to help students develop programs for clusters running Hadoop.

IBM 设计了开源软件去帮助学生们为运行 Hadoop 的集群开发程序。

Hadoop

Hadoop

分布式计算

分布式计算平台

分布式文件系统

大数据

云计算和大数据

分布式并行处理框架

热词推荐

大家在看