Scribd
Upload
37 views9 pages

Preview

Uploaded by

陶金

This document summarizes the architecture of Hue, an open source web interface for Hadoop. It consists of a Hue web server built with Django that serves as the front end, communicating via RPC calls to various Hadoop backend services like Hive and HDFS. When a user makes a request in their browser, the Hue web server handles the request, queries databases or backend services as needed, and returns dynamic pages rendered from templates to the user's browser.

Copyright:

© All Rights Reserved
Download as PDF, TXT or read online from Scribd
Download as pdf or txt

Preview

Uploaded by

陶金
37 views9 pages
This document summarizes the architecture of Hue, an open source web interface for Hadoop. It consists of a Hue web server built with Django that serves as the front end, communicating via RPC calls to various Hadoop backend services like Hive and HDFS. When a user makes a request in their browser, the Hue web server handles the request, queries databases or backend services as needed, and returns dynamic pages rendered from templates to the user's browser.

Copyright

© © All Rights Reserved

Available Formats

PDF, TXT or read online from Scribd

Did you find this document useful?

Is this content inappropriate?

This document summarizes the architecture of Hue, an open source web interface for Hadoop. It consists of a Hue web server built with Django that serves as the front end, communicating via RPC calls to various Hadoop backend services like Hive and HDFS. When a user makes a request in their browser, the Hue web server handles the request, queries databases or backend services as needed, and returns dynamic pages rendered from templates to the user's browser.

Copyright:

© All Rights Reserved
Download as PDF, TXT or read online from Scribd
Download as pdf or txt
37 views9 pages

Preview

Uploaded by

陶金
This document summarizes the architecture of Hue, an open source web interface for Hadoop. It consists of a Hue web server built with Django that serves as the front end, communicating via RPC calls to various Hadoop backend services like Hive and HDFS. When a user makes a request in their browser, the Hue web server handles the request, queries databases or backend services as needed, and returns dynamic pages rendered from templates to the user's browser.

Copyright:

© All Rights Reserved
Download as PDF, TXT or read online from Scribd
Download as pdf or txt
You are on page 1/ 9

Hadoop Web Server Browser

HTTP
Installed
Installed
Apps
Installed
Desktop
Core Web Server

{
Installed
Desktop
Apps
(Apps plug in here Desktop
Apps
using Django's Apps
urls and views.)
Hue WebServer
(CherryPy, running Django) database

Auxiliary
Installed

{
Servers
Installed
Desktop
Installed
Desktop
Apps
Desktop
Apps
Auxiliary Servers Apps
(Apps may run their own
auxiliary servers.)
Supervisor Server
(Manages Auxiliary Processes
The "supervisor" starts
all processes up.
Tier Technology Application
MooTools Custom JS

JFrame
Browser JavaScript CSS Tags

HTML/CSS HTML Pages

Mako Mako Templates

Hue Host Django Django "Views"

RPC Client
Python
(Thrift, HTTP, ...)

RPC RPC Server

Backend Services
Existing Services Existing Service

Required
For Example
Application Help Hive UI
pretty minimal more advanced
Self-Resizing Textarea;
Custom JS Create Table Wizard

Mouseovers;
CSS Tags Toolbar Management

HTML Pages Icon Styling

1 Template per
Mako Templates 1 Base Template
"Screen"

Django "Views" Renders Markdown Saving and Restoring


Files to HTML Queries
RPC Client
RPC to Beeswax
(Thrift, HTTP, ...)
Server; Hive Metastore

RPC Server Beeswax Server

Existing Service Hive Metastore

Hadoop MapReduce
Desktop Web Stack

jobsubd

Communication
bin/hadoop Thrift HTTP

NameNode JobTracker

Desktop NN Plugin Desktop JT Plugin

DataNode TaskTracker
DataNode TaskTracker
DataNode TaskTracker
DataNode TaskTracker
Desktop DN Plugin
Desktop DN Plugin
Desktop
Desktop DNPlugin
DN Plugin
"Unstyled" pages

GET /help

GET /filebrowser/view/user

This instance of Hue is running 2 applications, with one "JFrame" each.


The corresponding underlying requests are labelled.
HTTP GET

Typical Django Flow


WSGI Server

Middleware

Django URL Dispatch

Models

}
Middleware urls.py

External Servers Your App


View Function

Middleware Templates

HTTP Response
HTTP GET/POST HTTP Response

Django HTTP Request Handler

urls.py Resolve URL


(URL to a specific
Dispatch) python function

views.py
models (URL
Dispatch) mako
template Render
DB Business HTML
Logic

External Services
Default Linker XHR Request

Link is Clicked

Server Response

Filters Default Renderer

JFrame is Updated

You might also like