Quantcast
Channel: VMware Communities : Blog List - All Communities
Viewing all 3135 articles
Browse latest View live

Many Cores per Socket or Single-Core Socket Mystery

$
0
0

Hi All

 

During some readings, I remembered the eternal debatable Question when creating SMP VM (VM with many vCPUs):

"Which is better: many Cores in a single socket or many Sockets each with single core..??"

I remember how many times I debated for hours with my reporting manager -while reviewing some designs- about the same question, but neither of us could prove a bit.

To answer this question, we have to review some concepts.

 

NUMA CPU Configuration: Non Uniform Memory Access (NUMA) is a CPUs configuration, in which each CPU has some Memory DIMMs local and connected to it. Each CPU can access both its local memory DIMMs with lowest latency and the remote DIMMs with higher latency using Interconnecting Bus.

Many vExperts, and VMware itself, talked about this when if first came up supported in vSphere 3.5 (If I remember correctly!!) and how vSphere Platform is using NUMA Configuration to support SMP VMs. The best articles you can read about it and how it was supported are Frank Denneman's articles:

Sizing VMs and NUMA nodes - frankdenneman.nl

ESXi 4.1 NUMA Scheduling - frankdenneman.nl

Node Interleaving: Enable or Disable? - frankdenneman.nl

 

vNUMA CPU Configuration: vNUMA is Virtual NUMA. On a NUMA vSphere Host, when hosting large VM (9+ vCPUs), the host can expose NUMA configuration to the VM to gain additional performance boost. It was introduced with vSphere 5.0 and to gain this boost, VM hardware level must be 8+ and Guest OS and Guest Applications must be NUMA-aware.

 

Now let's quote the phrase from vSphere 5.5 ePubs that gave me a key to solve the mystery

You can affect the virtualNUMA topology with two settings in the vSphere Web Client: number of virtual sockets and number of cores per socket for a virtualmachine. If the number of cores per socket (cpuid.coresPerSocket) is greater than one, and the number of virtual cores in the virtual machine is greater than 8, the virtualNUMA node size matches the virtual socket size. If the number of cores per socket is less than or equal to one, virtualNUMA nodes are created to match the topology of the first physical host where the virtual machine is powered on.

Looking for those Advanced Settings, and I found those:

cupid.coresPerSocket & numa.vcpu.maxPerVirtualNode.

Referring to themhere:

Attribute

Description

Default

cpuid.coresPerSocket

Determines the number of virtual cores per virtualCPU socket. If the value is greater than 1, also determines the size of virtualNUMA nodes if avirtual machine has a virtualNUMA topology. You can set this option if you know the exact virtualNUMA topology for each physical host.

1

numa.vcpu.maxPerVirtualNodeIf cpuid.coresPerSocket is too restrictive as a power of two, you can setnuma.vcpu.maxPerVirtualNode directly. In this case, do not set cpuid.coresPerSocket.8

So, the first one is the number of cores per single vCPU socket, and the other one is controlling some behavior (Not clear, ha..??! )

 

Googling and searching about these two options lead me to this one of  VMware Blogs -by Mark Achtemichuk- about how number of cores per socket affects the performance and it solved all

Does corespersocket Affect Performance? | VMware vSphere Blog - VMware Blogs

 

According to the article, controlling number of cores per socket in VMs was introduced by VMware for just Licensing issues before vSphere 5.0 and later. When vNUMA was introduced in vSphere 5.0, another player came in the ground.

#1 When creating a virtual machine, by default, vSphere will create as many virtual sockets as you’ve requested vCPUs and the cores per socket is equal to one. I think of this configuration as “wide” and “flat.” This will enable vNUMA to select and present the best virtual NUMA topology to the guest operating system, which will be optimal on the underlying physical topology.

#2 When you must change the cores per socket though, commonly due to licensing constraints, ensure you mirror physical server’s NUMA topology. This is because when a virtual machine is no longer configured by default as “wide” and “flat,” vNUMA will not automatically pick the best NUMA configuration based on the physical server, but will instead honor your configuration – right or wrong – potentially leading to a topology mismatch that does affect performance.

Now let's put all the pieces together:

1-) When Creating any VM: By default, vSphere chooses to make by default the number of cores per vCPU socket is 1 (cupid.coresPerSocket=1 by default). In this case, and when the VM has more than 8 vCPUs (8 virtual sockets each with single virtual core), Virtual NUMA topology is created by default for this VM that comply with underlying physical NUMA topology, i.e. the vCPU configuration is modified automatically to comply with underlying physical NUMA. The max. number of cores in single virtual NUMA node -created by automatic Virtual NUMA which will equal the number of physical cores per NUMA node- is controlled by"numa.vcpu.maxPerVirtualNode" which is set by default to 8 (has to be changed if the physical NUMA node is greater than 8 physical cores).

2-)To enable Virtual NUMA manually on a large VM:you can set manually the number of cores per virtual socket (cupid.coresPerSocket>1). In this case, Virtual NUMA configuration will be set manually as configured and it will ignore the underlying physical NUMA configuration. "numa.vcpu.maxPerVirtualNode" has no effect in this case (Check the last test in VMware blog where he set Virtual NUMA to single socket with 24 cores).

3-) To enable Virtual NUMA manually on a small VM with certain Virtual NUMA Size:you have to set “numa.vcpu.min” to less than 9 first. Then, you can either set "numa.vcpu.maxPerVirtualNode" to the required number to set the Virtual NUMA required size while setting “cupid.coresPerSocket” to 1 or set the number of virtual sockets and virtual cores manually to set the required Virtual NUMA topology (which have to comply at least with the number of nodes in underlying physical NUMA topology).

 

Now, we can understand importance and necessity of setting the number of Virtual Sockets and Virtual Cores correctly in any VM. We can also now answer the eternal debatable Question:

"Which is better: many Cores in a single socket or many Sockets each with single core..??"

The answer is: It depends. If you understand exactly the underlying Physical NUMA topology, you can set many cores per socket in the VM to use Virtual NUMA benefits or take the easiest approach and set the number of cores to 1.

 

Share the knowledge ..



VMware Newsletter 6.34

$
0
0

From the editors virtual desk

Hi everyone, well VMworld US 2014 is over and there were so many announcements. While I did not make it to this fantastic event this year I am sure that I will next year. There were so many newsworthy articles produced, tweets and other posts from the many VMware staff at the event and our vExpert's and customers.

 

I know that with all of the amazing solutions announced that it will be another amazing year to be working with VMware technology.

 

This edition is dedicated to VMworld US 2014, all of the dedicated professionals who helped make this event a reality and of course our wonderful customers who make this event the amazing success that it is.

 

I hope you enjoy all of the wonderful news from this most fantastic event.

 

Virtually Yours

Neil Isserow

Senior Technical Account Manager

VMware Australia

nisserow @ vmware . com

 

VMworld 2014 US - http://www.vmworld.com/blogs/vmworld/

 

VMworld 2014 U.S. Wrap-up

 

What a great week at VMworld 2014 in San Francisco! As we wind down to recharge and then gear up for VMworld 2014 in Barcelona, here are a few resources to help wrap-up:


Blogs on news and announcements:
VMworld 2014 Bloggers Rollup
VMware Tribal Knowledge Blog wrap-up

 

Video playlists on VMworld TV (YouTube):
VMworld 2014 Highlights from San Francisco
VMworld 2014 Keynotes and Sessions

 

Note: Watch for an upcoming blog post on a week of VMworld 2014 LIVE video recordings from theCUBE Interviews, presented by SiliconAngle and Wikibon — and Community Tech Talks, presented by vBrownBag from the Hang Space. 

 

NEW! Watch video recordings of the Top 10 Sessions for Monday, Tuesday and Wednesday from VMworld 2014 U.S. (available for everyone). Scroll through the pages for top 10 from all 3 days. For all sessions, you must be a paid VMworld 2014 U.S. attendee.  Attendees will be notified when available in early September.

 

Watch for variety of offerings from our VMworld Social Media & Community page as we head into VMworld 2014 Europe. For example, the VMworld team curated a series of community postings into a VMworld Storify account. We will also be posting VMworld 2014 photo albums on Facebook, Flickr, Instagram, Pinterest.

 

VMware Bloggers

 

KB Articles

Desktop
Accessing the gateway-va URL in VMware Horizon Workspace fails with the error: HTTP 404 Error (2085347)
Date Published: 8/18/2014
Launching VMware Horizon View Hosted App from the VMware Workspace Portal fails with the error: Invalid SAML credentials (2086314)
Date Published: 8/20/2014
My VMware
How to edit your notifications in My VMware (2086791)
Date Published: 8/18/2014
VMware ESX
RAMDISK corruption causes new RHEL or CentOs to fail (2086520)
Date Published: 8/20/2014
VMware ESXi
Hotplug and unplug of disks on H710 controller (2077312)
Date Published: 8/18/2014
Hot unPlug and Plug of disks on P420i controller (2077426)
Date Published: 8/18/2014
Creation of native snapshot fails on an NFS datastore due to an issue with NetApp NAS plug-in (2085612)
Date Published: 8/20/2014
Unable to delete a storage policy (2085640)
Date Published: 8/18/2014
Virtual machines appears as Invalid immediately after it is added to the inventory (2085907)
Date Published: 8/19/2014
Hotplug and unplug of disks on LSI 9271-8i controller (2077427)
Date Published: 8/19/2014
VMware Horizon View
Using location-based printing in VMware Horizon View to map printers from a Universal Naming Convention (UNC) or share path (2086646)
Date Published: 8/21/2014
VMware ThinApp
Uninstalling the VMware Thinapp application fails with error: Failed to add Application in msg for UNINSTALL operation, vm install type not found (2085049)
Date Published: 8/18/2014
VMware vCenter Chargeback Manager
Upgrade of Chargeback Manager sets the INSTANCE_UUID filed as To_INITIALIZE (2085461)
Date Published: 8/19/2014
VMware vCenter Operations Manager (vApp)
Unable to register a vCenter Server in vCenter Operations Manager following changed UUID (2068856)
Date Published: 8/21/2014
Attempts to access the vSphere UI using only the IP address fail (2084752)
Date Published: 8/18/2014
VMware vCenter Server
Cannot login to or manage vCenter SQL Express instance (VIM_SQLEXP) running on VMware vCenter Server (2063510)
Date Published: 8/19/2014
Creating Link Aggregation Groups (LAGs) using a VMware legacy vSphere Client fails and reports the error: Basic support (2078639)
Date Published: 8/20/2014
Historical Performance charts do not appear in vCenter Server 5.1 with an Oracle database (2085985)
Date Published: 8/20/2014
Running the VMware vCenter Server Proactive Oracle Checking (VPOC) tool for vCenter Server 5.1/5.5 (2086126)
Date Published: 8/18/2014
VMware vCloud Automation Center
Backing up the VMware vCloud Automation Center (vCAC) Postgres database (2086958)
Date Published: 8/21/2014
VMware vCloud Director
vCloud Director 5.5 requirements when using NFS for the transfer server storage (2086127)
Date Published: 8/19/2014
VMware View
Logging in to a VMware Horizon View desktop in a multi-domain environment fails with the error: Authentication Failed (2085374)
Date Published: 8/18/2014
VMware vSphere Data Protection
Configuring VDP services to run as VDPBackupUser (2086674)
Date Published: 8/19/2014
VMware vSphere Replication
Missing or corrupted OVF environment in VMware vSphere Replication (2084652)
Date Published: 8/21/2014

PowerCLI で vCenter 設定情報を取得(簡易版)

$
0
0

以前、PowerCLI で vCenter の設定情報を取得するポストをしましたが・・・

vCenter 5.x の設定をPowerCLIで確認してみる


もっと、簡単なコマンドラインで取得できることに気づきました。

$global:DefaultVIServers と、Get-AdvancedSetting を使用します。

PowerCLI で接続中 vCenter の確認。($global:DefaultVIServers)

 

この1行だけでも、接続中 vCenter の設定情報が取得できます。

PowerCLI> $global:DefaultVIServers | Get-AdvancedSetting

 

最初に、vCenter に接続しておきます。

この例の環境では、独自の Active Directory を使用しているため

VMAD\Administrator というユーザで接続していますが、

administrator@vsphere.local (デフォルト管理者)などのユーザのほうが一般的かもしれません。

PowerCLI> Connect-VIServer vc55u1-1.vmad.local -User vmad\administrator -Password ******

 

Name                           Port  User

----                           ----  ----

vc55u1-1.vmad.local            443   VMAD\Administrator

 

PowerCLI> $global:DefaultVIServers

 

Name                           Port  User

----                           ----  ----

vc55u1-1.vmad.local            443   VMAD\Administrator


Get-AdvancedSetting では、下記のように情報取得できます。

※見やすくするために「select ~」も付けています。

PowerCLI> $global:DefaultVIServers | Get-AdvancedSetting | select Entity,Name,Value | ft -AutoSize

 

Entity              Name                            Value

------              ----                            -----

vc55u1-1.vmad.local ads.checkInterval                1440

vc55u1-1.vmad.local ads.checkIntervalEnabled         True

vc55u1-1.vmad.local ads.maxFetch                     5000

vc55u1-1.vmad.local ads.maxFetchEnabled              True

vc55u1-1.vmad.local ads.timeout                        60

vc55u1-1.vmad.local AgentUpgrade.autoUpgradeAgents   True

vc55u1-1.vmad.local AgentUpgrade.checkPeriodSeconds    30

vc55u1-1.vmad.local alarms.upgraded                 False

vc55u1-1.vmad.local alarms.version                     30

vc55u1-1.vmad.local client.timeout.long               120

(以下省略)

 

設定項目が多いので、下記のように Export-Csv を使うと、

CSV ファイルに設定を保存できます。

※例では「C:\work\vc_advanced_setting.csv」というファイルに保存しています。

PowerCLI> $global:DefaultVIServers | Get-AdvancedSetting | select Entity,Name,Value,Description | Export-Csv -Encoding utf8 -NoTypeInformation -Path C:\work\vc_advanced_setting.csv

PowerCLI> cat C:\work\vc_advanced_setting.csv

"Entity","Name","Value","Description"

"vc55u1-1.vmad.local","ads.checkInterval","1440","User validation interval"

"vc55u1-1.vmad.local","ads.checkIntervalEnabled","True","Enable user validation"

"vc55u1-1.vmad.local","ads.maxFetch","5000","Maximum users to retrieve"

"vc55u1-1.vmad.local","ads.maxFetchEnabled","True","Enable user retrieve limits"

"vc55u1-1.vmad.local","ads.timeout","60","User retrieve timeout"

"vc55u1-1.vmad.local","AgentUpgrade.autoUpgradeAgents","True","vCenter Agent Upgrade"

"vc55u1-1.vmad.local","AgentUpgrade.checkPeriodSeconds","30","Host upgrade check frequency"

"vc55u1-1.vmad.local","alarms.upgraded","False","Default alarms have been created"

"vc55u1-1.vmad.local","alarms.version","30","Default alarm upgrade version"

(以下省略)


下記のように、個別のパラメータだけに絞って

確認したい設定項目だけを表示することもできます。

PowerCLI> $global:DefaultVIServers | Get-AdvancedSetting | select Entity,Name,Value,Description | where {$_.Name -like "event.*"} | ft -AutoSize

 

Entity              Name                Value Description

------              ----                ----- -----------

vc55u1-1.vmad.local event.maxAge          180 Maximum event age

vc55u1-1.vmad.local event.maxAgeEnabled False Enable event cleanup

 

PowerCLI> $global:DefaultVIServers | Get-AdvancedSetting | select Entity,Name,Value,Description | where {$_.Name -eq "event.maxAge"} | ft -AutoSize

 

Entity              Name         Value Description

------              ----         ----- -----------

vc55u1-1.vmad.local event.maxAge   180 Maximum event age

 

ちなみに、今回も PowerCLI バージョンは 5.5 R2 でした。

PowerCLI> $version.UserFriendlyVersion

VMware vSphere PowerCLI 5.5 Release 2 build 1671586

 

以上です。PowerCLI での vCenter 設定情報取得についてでした。

My VMworld 2014 Experience

$
0
0

1st Time at VMworld

My VMworld 2014 experience was quite awesome to say the least. It was awesome due to a bunch of factors actually. First off it was my 1st pilgrimage to VMworld and San Francisco for that matter. Taking in the sights and sounds of San Fran was really cool for me. Second, I was excited to meet up with some old friends from previous jobs and share the technological nerdiness with someone other than my wife, who is a damn saint for listening to my VMware babble since the moment I knew I was going to VMworld! And lastly, I was interested in finally meeting those fellow virtualization evangelists who I have only known via their Twitter or VMware Community avatars. Putting faces & avatars to real names & real faces is just priceless to me.

So it begins

So I started my week off early on Saturday morning with my wonderful wife dropping me off at the airport at what we like to call the “butt-crack of dawn” in our house. If its before 9am on a Saturday, its too early for us! My flight got me into SFO around 11:30am at which point I quickly hailed a cab and made it to my hotel in the Fisherman’s Wharf area (yes, I know, kinda far from the Moscone Center. Maybe I will blog about that later).

 

I dropped my bags and within the hour, met up with my buddy Anton Major (http://antonmajor.com/) whom I used to work with back in my Pfizer days out in Dirty Jersey. Predetermined before we arrived, we quickly booked it to the nearest tourist spot, Pier 39 for a huge bread bowl full of clam chowder accompanied with adult beverages. We caught up on family & work life and Saturday quickly became Sunday…but not before experiencing my 1st Earthquake! HOLY CRAP, WHAT? At about 3:20am PST I was awakened (along with many other VMworld fans) by the room and building shaking due to that 6.1 ground shaker that seemed to be the biggest quake in Cali since 1989. Wow, that was freaky and cool all in the same strange way.


Sunday morning I was off and ready to start my VMworld stint with an early morning certification exam at the conf center. Well, that ended in a bad way. I have to admit that I failed my VCP5-DT (VCP510-DT, VMware View) exam by a mere 10 points. Garbage I tell you! Oh well, you live and learn, pull yourself back up and fight for it again. That’s the best I can do. I will tackle that tough one again before this year is over. Sunday was filled with cool events from the VMware Community to the annual #vOdgeball Event (Dodgeball for those not following the “v” placement), a pretty cool day I’d say.

Monday through Thursday was just that, almost a blur as it happened so fast. General Sessions turned into Breakout Sessions, lunch, sessions, dinners, meet/greets, etc, etc. I won’t bore you with the daily routines. I wanted to sum up these days as fast, full of info and worth the time if you can pause them or slow them down a bit. What I mean by this is, leaving time to network and talk to others like myself or bloggers that I follow online. Where I found the most value, was in the Hang Space.

 

The Hang Space is not to be missed, seriously, do not skip this area at VMworld. As a 1st timer I was not sure what to expect in the Hang Space besides I heard that’s where Cody Bunch would be running the vBrownBag events, more than likely barefoot. True! All kidding aside, this area is where I made new friends, connected with old friends, and was able to talk to people from the community, bloggers, authors, and other 1st time VMworld goers. Tremendous value here. Skip a session or two and visit the Hang Space, it wont hurt you it will only make you stronger in my opinion.

Extra Credit

I had the opportunity to do a short presentation as well as shoot 2 video interviews while at VMworld 2014. That in itself was pretty epic. I will post more links or videos as I get a hold of them but I would like to say a few ‘thank yous’ to the following people & companies for being awesome as well as down to earth good humans.

 

Thank You:

  • National Specialty Alloys, my employer for sending me to VMworld! Best. Employer. Ever.
  • Cody Bunch, Alastair Cooke& the entire #vBrownBag crew for letting me present
  • Matt, Carrie, Arun, Peter, Joe, Jonathan, Adam, Eric, Sheryl, Vishal, Scott, and the entireTeam Infinio for being so hospitable from the show floor all the way to dinner. Thank you for the great interview too!
  • Caroline, Jen, Symantec Matt& my awesome Spiceworks family, near & far. You guys rule as well as pick great talent for videos!
  • Corey& the VMware Community Teams, awesome job and such a pleasure to meet y’all!
  • James Bowling& Emad Younis and the rest of my HOU-VMUG family for their support at VMworld and all year.
  • Lastly I would like to Thank Linus Bourque (Author of the VCP5-DT Study Guide) who in any other venue I probably would not have approached, but the Hang Space again was very chill so this helped. Linus took the time to talk to me about my questions/concerns of my recent exam failure last week. We talked in depth of best ways to study again, new features coming soon & he even offered to chat over email if that could help guide me to pass my exam next round. A super nice guy. A sincere thanks buddy.

 

 

http://nigelhickey.com/vmworld-2014-experience/

VCO Appliance -5.5.0.0 Build 1282845 – Login Issue

$
0
0

VCO Appliance -5.5.0.0 Build 1282845 – Login Issue Error message "org.spring.framework.remoting.RemoteAcessException" This error may occurs for 2 reasons 1. When local disk is full with Logs files 2. Networking" tab was set to 0.0.0.0 1. To clear logs On VCO configurator page:  Stop VCO service.  Navigate to Troubleshooting tab and click "Clean Directories" to clear the temporary files.  Start VCO service. (We were then able to reach: 8281 and login to the VCO client. 2. Networking" tab was set to 0.0.0.0 On VCO configurator page:  Go to Networking tab  Change the vCO IP address,  Run the plugins  Restart the VCO service The above mentioned steps will resolve the VCO login issues.

vCenter Log Insight を VCOPS と統合してみる。

$
0
0

Log Insight と、

vCenter Operations Manager(VCOPS)が統合できるようなので

ためしに統合してみました。

 

VCOPS はバージョン 5.8.1 、

Log Insight は バージョン 2.0.3 です。

 

ちなみに VCOPS の admin UI を見ると、統合前は下記のように

「vCenter Log Insight は統合されていません。」 となっています。

vcops-logInsight01.png

 

Log Insight を VCOPS に統合する設定


VCOPS との統合は、Log Insight 側で設定します。

vcops-logInsight02.png

 

Log Insight の Web UI 画面右上から「Administration」を開きます。

vcops-logInsight03.png

 

右画面にある「vCenter Operations Manager」を開いて、

VCOPS のアドレスと、

標準 UI にログインできるユーザ(例では admin)とパスワードを入力します。

 

「Enable alerts integration」と

「Enable launch in context」は

どちらもチェックを ON にしておきます。


「Test Connection」をクリックして「Test successful」 になることを確認したら

「Save」します。

vcops-logInsight04.png


設定が終わるまで、数分待ちます。

vcops-logInsight05.png

 

設定が終わりました。

vcops-logInsight06.png

 

VCOPS と Log Insight が統合されたことを確認

 

VCOPS の admin UI で確認してみると・・・

vcops-logInsight07.png

 

「登録」タブの一番下に、

Log Insight サーバのアドレスが表示されるようになります。

vcops-logInsight08.png

 

VCOPS の標準 UI では、

「アクション」メニューに

「Search for Logs in vCenter Log Insight...」が追加されます。

これをクリックすると、VCOPS で選択されているオブジェクト

検索された状態の Log Insight が開かれます。

※下記の例だと、hv55n2.vmad.local という ESXi が検索された状態で表示されます。

vcops-logInsight09.png

 

VCOPS でアラートが検知されている場合は、

そのアラート(例では「vSphere HA detected ~」)を選択して

「外部アプリケーションで開く」ボタンをクリックしても

同様に Log Insight 開くことができます。

vcops-logInsight10.png

 

開かれる Log Insight は、こんな感じです。

「Interactive Analytics」画面が、

そのオブジェクトを検索した状態で表示されます。

表示された結果から、さらにログを絞り込んだりできます・・・

vcops-logInsight11.png

 

逆に、Log Insight が収集したログ内容をもとに

VCOPS にむけてアラート発報したりもできるようです。

 

こちらもどうぞ・・・

vCenter Log Insight のデプロイ。

vCenter Log Insight のデプロイの続き。

vCenter Log Insight に VC 追加登録。

 

以上、VCOPS と Log Insight を連携させてみる話でした。

Visit CloudCred

$
0
0

Screen Shot 2014-09-15 at 2.49.49 PM.png

 

CloudCredibility.com is a valuable resource for IT professionals at every level to learn new skills, stay abreast of current technologies, create new professional alliances or build on established connections, and contribute to the Cloud Community in a fun, professional venue.

 

If you haven't stopped in at CloudCredibility.com to create an account and get started, or if it's been awhile, here's what is waiting for you:

 

  • Over 1500 specific technical tasks in more than 20 categories, created to both sharpen your expertise and encourage you to share insights with other players.
    • +30 Log Insight Tasks  - Storage Policy, Health check, Alerts, and more.
    • +50 NSX Tasks, including a 12-part series based on Scott Lowe's blog, and a four-part installation video series
    • +100 VSAN Tasks, including a 25-part series based on Cormac Hogan's blog, and a five-part series on VSAN APIs
    • +50 VCA Badge Module Tasks - Looking to earn one of these valuable credentials? Check out the VCA Prep Tasks for WM, Cloud, and DCV

 

  • Four "Worlds" - CloudCred (general tasks); VSAN World; Log Insight World, and NSX World - each featuring its own specific tasks & leaderboards for niche competition. In addition, LABS World will re-release after VMworld EUEA (October, 2014), to include the current, excellent Hands-On Labs created specifically for VMworld.

Screen Shot 2014-09-15 at 2.53.43 PM.pngScreen Shot 2014-09-15 at 2.53.24 PM.pngScreen Shot 2014-09-15 at 2.52.55 PM.pngScreen Shot 2014-09-15 at 2.52.33 PM.png

 

Screen Shot 2014-09-15 at 2.55.44 PM.png

 

  • So Get Started:
    • Creating an account is simple - so is joining a team! If you'd like to switch teams, you can easily join any team that's not at capacity.
    • Then, simply browse the site, OR check out our list of Anniversary Tasks - designated as such due to their long-term value and popularity

 

Play today, Play every day!

- at CloudCred

vSphere で Hadoop してみる。(Big Data Extentions) 第1回

$
0
0

Hadoop 検証環境がほしくなり、

せっかくなので vSphere Big Data Extentions(BDE)を試してみようと思います。


vSphere Big Data Extensions

http://www.vmware.com/jp/products/big-data-extensions

 

BDE は、vSphere 環境で

Hadoop クラスタの自動プロビジョニングや VM 追加などができるソリューションです。

GUI(vSphere Web Client のプラグイン)と

CLI(serengeti)どちらでも、Hadoop 環境を構築できます。

ちなみに、これまで serengeti というプロジェクトで取り組まれていたもので

その名前が残っています。

 

この機能は、OVF 形式(.ova ファイル)で提供されていて、

vCenter から vApp としてデプロイできます。

 

BDE の vApp は、2つの VM を含みます。

この BDE で Hadoop クラスタを構成する場合は

検証目的でも Hadoop 環境にそこそこマシンスペックが高くないと厳しいと思いますが

この vApp 自体にはそんなにリソースを必要としません。

  • management-server
    Hadoop クラスタの自動プロビジョニングや、
    クラスタへのノード追加、自動削除をする、BDEの管理サーバです。
    SSH でログインして、CLI(serengeti という名前)を実行することもできます。
  • hadoop-template
    Hadoop 関連のサーバを自動構成する時に使用するテンプレート用 VM です
    vApp に含まれますが、普段は起動しない VM です。

 

それでは、BDE をデプロイしてみます。

今回は、vSphere 5.5 u1 の環境を使用しています。

 

まず、Web Client で vCenter にログインして、

インベントリのどこかに「OVF テンプレートのデプロイ」 をします。

vApp なので、一応 DRS クラスタにデプロイしています。

bde-deploy01.png

 

BDE の OVF ファイルを指定します。

  • VMware-BigDataExtensions-2.0.0.951-1885370_OVF10.ova

今回は、BDE 2.0 を使用しています。評価版は MyVMware からダウンロードできます。

bde-deploy02.png

 

BDE の vApp は、

シックプロビジョニングの場合、デプロイに 40GB 以上のディスク容量が必要です。

シン プロビジョニングであれば、10GB に収まるようです。(初期だと 7.6GB)

これとはべつに、Hadoop クラスタの容量が必要になります。

bde-deploy03.png

 

EULA を「承諾」して「次へ」をクリック。

bde-deploy04.png

 

vApp の名前を変更できます。デフォルトだと

「vSphere Big Data Extensions Server」です。

bde-deploy05.png

 

デプロイ先のデータストアを指定します。

今回は データストアの空き容量があまりなく、

検証環境なので、今回は「Thin Provision」(シン プロビジョニング)にしました。

bde-deploy06.png

 

BDE の vApp に含まれる、

管理サーバが使用するネットワーク(ポートグループ)を指定します。

Network 1 は IPv4、Network 2 は IPv6 で使用するようです。

bde-deploy07.png

 

BDE の管理サーバに対する設定を入力します。

  • 「Initialize Resources?」のチェックは ON にしておきます。
  • VCSSO(vCenter SSO)の Lookup Service の URL は、
    ホスト名の部分を VCSSOのアドレスに書き換えます。
    VCSSOは、だいたいvCenter と一緒だと思うので、
    ここでは、vCenter のアドレスを指定することが多いでしょう。
  • 参照する DNS サーバのアドレスもここで指定します。

まだこの画面で入力します・・・

bde-deploy08.png

 

管理サーバのネットワーク設定も入力します。

  • ネットワーク設定のタイプ(Static か、DHCP か)
  • IP アドレス
  • ネットマスク
  • デフォルトゲートウェイ

入力したら「次へ」。

bde-deploy09.png

 

ちなみに、上記の画面の「~ Network 2 Settings」では IPv6 の設定も出来ますが、

今回は IPv6 を使用しないのでデフォルトのままにしています。

bde-deploy10.png

 

「次へ」・・・

bde-deploy11.png

 

確認画面が表示されるので、内容を確認して「終了」すると

OVF のデプロイ処理が開始されます。

bde-deploy12.png

 

OVF のデプロイ処理が完了すると、

下記のように vApp が作成されています。

VM が 2つ含まれていることもわかります。

bde-deploy13.png

 

vApp を「パワーオン」します。

bde-deploy14.png

 

BDE の管理サーバ(management-server)だけ起動し

テンプレート用 VM(hadoop-template) は起動されません。

bde-deploy15.png

 

以上、BDE のデプロイでした。セットアップはつづく・・・


vSphere で Hadoop してみる。BDE 第2回

$
0
0

前回につづき、

vSphere Big Data Extensions(BDE)をセットアップしていきます。

 

前回はこちら・・・

vSphere で Hadoop してみる。(Big Data Extentions) 第1回

 

まずは、BDE の vApp を起動します。

bde-setup01.png

 

vApp に含まれる VM のうち、

BDE 管理サーバ(management-server)だけがパワーオンされます。

bde-setup02.png

 

management-server をコンソールで開くと

初期パスワードが表示されているので、

このまま Enter キーなどを押して serengeti ユーザでログインして

すぐ下に表示されているコマンドラインでパスワードを変更します。

※ちなみに、SSH で ログインしてパスワード変更することもできます。

bde-setup03.png

 

パスワード変更は、こんな感じです。

[serengeti@192 ~]$ sudo /opt/serengeti/sbin/set-password -u

New password: ★パスワードを入力する。

Retype password: ★もう一度パスワードを入力する。

[serengeti@192 ~]$

 

Web Client に BDE のプラグインを登録します。

下記の URL にアクセスすると、登録画面が表示されます。

    https://<management-server の IP アドレス>:8443/register-plugin/

 

「Install」を選択して、vCenter のアドレスと

vCenter にログインできる管理者ユーザ名 / パスワード を入力します。

 

「Big Data Extentions Package URL」の

IP アドレスの部分は、起動した BDE 管理サーバのものです。

 

入力したら「Submit」します。

bde-setup04.png

 

「Installation successful! ~」と表示されます。

bde-setup05.png

 

Web Client にログインしなおすと・・・

bde-setup06.png

 

BDE のプラグインが登録されています。

アイコンをクリックして、BDE の画面を開きます。

bde-setup07.png

 

BDE の管理サーバに接続します。

「Geting Start」のタブで

「Connect to a Serengeti Server」をクリックします。

※Serengeti Server は、BDE 管理サーバのことです。

bde-setup08.png

 

インベントリから、management-server を選択して「OK」をクリックします。

bde-setup09.png

 

証明書の警告が出ますが「OK」をクリックします。

bde-setup10.png

 

BDE 管理サーバが登録されて、

Big Data Cluster 作成などができるようになりました。

これで、GUI (この Web Client)から Hadoop クラスタがデプロイできるようになります。

bde-setup11.png

 

「Summary」タブでも、

BDE 管理サーバが登録されたことがわかります。

bde-setup12.png

 

ちなみに、BDE 管理サーバに SSH でログインすると

CLI で Hadoop クラスタをデプロイすることもできます。

 

日本語環境の都合でバックスラッシュが「\」になって

CLI ログイン時の serengeti のロゴがうまく表示できてませんが・・・

bde-setup13.png

 

以上、BDE のセットアップでした。まだつづく・・・

vSphere で Hadoop してみる。BDE 第3回

$
0
0

今回から、

vSphere Big Data Extensions(BDE)で

vSphere 環境に Hadoop クラスタを作成してみます。

 

これまでの流れ

vSphere で Hadoop してみる。(Big Data Extentions) 第1回

vSphere で Hadoop してみる。BDE 第2回

 

今回は BDE で Hadoop クラスタを作成する準備として下記を実施します。

  • BDE で使用するストレージの指定
  • BDE で使用するネットワークの指定
  • Hadoop クラスタで利用するリソースプールの作成

 

BDE でリソースの指定は、

vSphere Web Client の BDE プラグインの画面で設定します。

 

Web Client にログインしたら、「ホーム」で

「Big Data Extentions」を開きます。

bde-res-setting-01.png

 

BDE の画面が開くので「Resources」を開きます。

bde-res-setting-02.png

 

BDE で使用するストレージの指定


BDE でストレージを利用するには、

すでに vSphere 環境で作成してあるデータストアを指定します。


「Invenory Lists」配下の「Datastores」を開いて「+」ボタンをクリックして下記を設定します。

  • BDE でのデータストアの名前。データストアに BDE 独自の名前を設定します。
  • Type → データストアのタイプを指定します。Local か Shared。
  • 使用するデータストアのチェックを ON にします。

bde-res-setting-03.png

 

指定したデータストアは、

下記のように表示されるようになります。

bde-res-setting-04.png

 

BDE で使用するネットワークの指定


BDE でストレージを利用するには、

すでに vSphere 環境で作成してあるポートグループを指定します。

vSS の標準ポートグループでも、vDS の分散ポートグループでも

どちらでも指定できます。


「Invenory Lists」配下の「Networks」を開いて「+」ボタンをクリックして下記を設定します。

  • BDE でのネットワークの名前。ポートグループに BDE 独自の名前を設定します。。
  • 使用するデータストアのチェックを選択する。
  • IP アドレス設定を、DHCP か、静的に指定かを選択します。

 

ちなみに、今回はもともと DHCP サーバがいるネットワークセグメントの

ポートグループを使用するつもりなので、DHCP を選択しています。

bde-res-setting-05.png

 

指定したネットワークは、

下記のように表示されるようになります。

bde-res-setting-06.png

 

Hadoop クラスタで利用するリソースプールの作成

 

BDE での Hadoop クラスタを作成先として

リソースプールを作成しておきます。

これは、BDE 独自のリソースではなく

普通に vSphere 環境で作成できる一般的な「リソースプール」のことです。

 

Web Client の「ホストおよびクラスタ」インベントリで、

vSphere のクラスタに対して「新規リソースプール」を作成します。

bde-res-setting-07.png

 

今回のリソースプールには、リソースプール名だけ指定しておきます。

ちなみにリソースプールで CPU、メモリのリソース制御設定をした場合は、

BDE で作成する Hadoop クラスタにも反映されるはずです。

bde-res-setting-08.png

 

リソースプールが作成されました。

この時点では VM 等が何も含まれていません。

bde-res-setting-09.png

 

このあとは BDE での

Hadoop クラスタ作成に続く・・・

Hi All

$
0
0

Any one could you please share

 

How to convert a physical Linux machine to virtual machine? If you share the documents it's really helpfull.

 

Regards

Ravi

vSphere で Hadoop してみる。BDE 第4回

$
0
0

今回は、前回までの流れをひきついで

vSphere Big Data Extensions(BDE)で Hadoop クラスタを作成してみます。


Web ブラウザからでも、CLI でもクラスタ作成することができますが、

今回は Web ブラウザ(BDE の vSphere Web Client プラグイン)から実施します。

この Web Client は、普段 vCenter にアクセスする Web Client と同じものです。

 

これまでの BDE ポストはこちら。

vSphere で Hadoop してみる。(Big Data Extentions) 第1回

vSphere で Hadoop してみる。BDE 第2回

vSphere で Hadoop してみる。BDE 第3回

 

BDE でデプロイする Hadoop ディストリビューションについて

 

BDE には、デフォルトでは

Apache の コミュニティ版 の Hadoop 1.2 と bigtop が

ディストリビューションとして登録されています。


BDE に登録されているディストリビューションは、

BDE の vSphere Web Client プラグインの「Hadoop Distributions」から確認できます。

bde-new-cluster-01.png


他にもいくつかの Hadoop ディストリビューション(CDH や MapR など)

に対応していて、追加するとこの画面に表示されるようになります。

 

マニュアルでは下記のあたりを参照・・・

VMware vSphere Big Data Extensions Administrator's and User's Guide

Hadoop Feature Support By Distribution

http://pubs.vmware.com/bde-2/topic/com.vmware.bigdataextensions.admin.doc/GUID-2D9092BA-771B-4FCC-AE5C-72761720D303.html

 

BDE での Hadoop クラスタ自動構築

 

それでは、Hadoop クラスタを作成してみます。

「ホーム」から「Big Data Extentions」の画面を開いて、

「Big Data Clusters」→「Getting Started」→

「Create a New Big Data Cluster」をクリックします。

bde-new-cluster-02.png

 

Name and node group 画面で、下記を指定します。

  • Name
    BDE で独自に使用するクラスタの名前を指定します。
  • Hadoop distribution
    使用する Hadoop ディストリビューションを選択します。
    今回はコミュニティ版 Hadoop を使用します。
  • Deployment type
    Hadoop をどのようなクラスタ構成にするか、HBbase クラスタにするかなど。
    この選択内容によって、すぐ下に表示されている Node group で
    設定できるものが変化します。

bde-new-cluster-03.png

 

Hadoop クラスタのノード構成を決めます。今回のように

Deployment type で「Basic Hadoop Cluster」を指定している場合は

ノードグループは下記の4つになります。

  • DataMaster Node Group(HDFS のマスタになるサーバ)
  • ComputeMaster Node Group(MapReduce のマスタになるサーバ)
  • Worker Node Group(HDFS と MapReduce のスレーブになるサーバ)
  • Client Node Group(Hadoop に処理をさせるクライアント。なくてもよい)

 

それぞれのグループで、仮想マシン数を指定し、

「Resource template」で割り当てるリソースを指定します。

Large、Medium...といったあらかじめ用意されたテンプレートがありますが、

今回は出来るだけ小規模にしたいので、すべて「Customize」を指定しました。


DataMaster と ComputeMaster は下記が最小リソース構成です。

「Basic Hadoop Cluster」を指定する場合は、

DataMaster、ComputeMaster どちらも 1台だけになります。

bde-new-cluster-04.png

 

Worker と Client は下記が最小リソース構成のようです。

Worker は、せっかくなので2台にしました。(デフォルトは3台)

bde-new-cluster-05.png

 

「Resource template」で「Customize」を選択する場合は、

下記のような指定ができます。

  • vCPU 数
  • メモリ容量
  • ストレージ容量
    各サーバに、この容量の VMDK ファイルが 自動追加されます。
  • Datastore type
    事前に BDE で使用できるようにリソース登録したデータストアのうち、
    Local、Shared どちらとして定義したものを使用するか指定します。

bde-new-cluster-05a.png

 

ちなみに、最小値よりも小さくしようとするとエラーになります。

メモリなどは最小値自体が結構大きいので、

検証目的で利用する場合など、物理サーバのスペックが低い環境では要注意だと思います。

bde-new-cluster-05b.png

 

Hadoop のトポロジと、クローンされた VM を接続するネットワークを指定します。

トポロジは、BDE デプロイ直後は「HOST_AS_RACK」と「NONE」が選択できます。

※これは MapReduce や HDFS の動作に影響を与えます。詳しくは別途…(ないかも)


ネットワークは、BDE に事前登録してあるポートグループから指定できます。

ここで選択する名前は、通常のポートグループ名でははなく

BDE にリソース登録した時に指定した名前です。

※Customize にチェックを入れると、もう少し細かく使用ネットワークを指定できます。

bde-new-cluster-06.png

 

Hadoop クラスタの作成先となるリソースプールを指定します。

ここで指定するリソースプールは、事前に作成しておく必要があります。

このリソースプールの下に、さらに子リソースプールが自動作成されて VM がクローンされます。

bde-new-cluster-07.png

 

自動クローンされる VM の、ゲスト OS の root パスワードを指定します。

今回は、「Set password」を指定します。

デプロイされた Hadoop クラスタに含まれるゲスト OS の root ユーザには

自動的にこのパスワードがセットされます。

ちなみに、デプロイされるゲスト OS は CentOS 6.4 64bit です。

bde-new-cluster-08.png

 

設定内容が表示されるので、確認して「終了」をクリックします。

bde-new-cluster-09.png

 

Hadoop クラスタの自動構築が開始されます。

bde-new-cluster-10.png

 

vCenter に vSphere Client で接続してみると、

リソースプール作成や VM をクローンしている様子が見やすいと思います。

bde-new-cluster-11.png

 

処理がすべて完了すると、

自動構築したクラスタのすべてのゲスト OS が自動設定されて、VM が起動された状態になります。

bde-new-cluster-12.png

 

クラスタ名をダブルクリックして開くと、

今回の Hadoop クラスタ(hdp_cluster01)には5台の VM が含まれることがわかります。

VM 名は自動設定されたものです。

bde-new-cluster-13.png

 

「ホストおよびクラスタ」インベントリから見ると、このような感じになります。

bde-new-cluster-14.png

 

ちなみに、このクラスタ自動構築処理は複数台の VM をクローンしたりするので、

結構時間がかかります。(数時間かかることがあります)

Nested ESXi 環境などで Hadoop クラスタを 1台の HDD にすべて乗せたりする場合は

半日くらいかかると思っておいた方がよいです。

 

以上、Web Client + BDE での Hadoop クラスタ自動作成でした。

まだまだ続く・・・

VMware Newsletter 6.35

$
0
0

Email not displaying correctly? View it in your browser: http://us2.campaign-archive1.com/?u=84638d120599c4461b514e1a0&id=7bb4919603&e=[UNIQID]

 

From the editors virtual desk

Hi everyone, well as the titles says this is my last VMware newsletter that I will be producing from my current hometown of Brisbane, Australia. I have lived in this beautiful city for the past 8+ years and it has been really amazing. I am now heading off to  the USA to live and work in San Francisco. I am incredibly excited to have this opportunity given to me by my fantastic employer, VMware. The newsletter will continue as usual, there will be no major interruptions except possibly while I get myself setup when I arrive in my new City.

 

I want to thank all of my customers and colleagues for all of their support over the past 5 and a half years at VMware in Brisbane. It has been an outstanding time for me personally and I have enjoyed working with each of you.

 

I hope that you will choose to continue to receive the newsletter from San Francisco. Of course you are always able to unsubscribe by using the personal link at the end of each edition, but I really hope you will stay as a subscriber, and I promise to continue to bring you the latest VMware news direct from San Francisco each week.

 

My latest blog posting for those that have been following is titled "Why do we still build Virtual Machines like their Physical Counterparts” and can be found here: http://tinyurl.com/on2kdj5

 

Take care everyone, have a fantastic and productive week and I look forward to chatting to you again next week from my new home in San Francisco.

 

Virtually Yours

Neil Isserow

Staff Technical Account Manager

VMware

nisserow @ vmware . com

 

VMWARE BLOGGERS

  1. Top 20 Articles for August 2014 (http://blogs.vmware.com/kb/?p=6254)Here is our Top 20 KB list for August 2014. This list is ranked by the number of times a VMware Support Request was resolved by following the steps in a published Knowledge Base article. 1. VMware ESXi 5.x host experiences a purple diagnostic screen mentioning E1000PollRxRing and E1000DevRx (2059053) 2. Installing async drivers on […]

     

  2.  

    Weekly News Recap, Sept. 5, 2014 (http://blogs.vmware.com/tribalknowledge/?p=2993)The Weekly News Recap has returned! We took a short break during VMworld US, but we’re back with the latest VMware and industry updates. You may have noticed that we’ve changed the name of the VMware Company Blog – to Tribal Knowledge! Read more about Tribal Knowledge and the team here and be sure to […]

     

  3.  

    VMware continues EUC momentum at AirWatch Connect (http://blogs.vmware.com/tribalknowledge/?p=2981)On the heels of a successful VMworld, VMware’s EUC division is keeping the momentum going with an enterprise mobility conference beginning next Monday. AirWatch Connect Atlanta brings together the brightest minds in mobility, Sept. 8–11 for four days of education, product updates, networking and more. Follow along on the AirWatch Blog for the latest EUC […]

     

  4.  

    VMware’s Office of the CTO Announces Third Annual Fling Contest (http://blogs.vmware.com/tribalknowledge/?p=2975)Grab your thinking cap and get those creative juices flowing, because VMware’s Third Annual Fling Contest has just kicked off! This annual tradition has been running (with some name changes along the way) for two years now, and we are excited to bring it back for 2014. Flings are free apps and tools that are […]

     

  5.  

    VMware’s Call to IT Professionals: Be Brave (http://blogs.vmware.com/cloudops/?p=1127)At VMworld last week, VMware CEO Pat Gelsinger laid it out: IT is no place for the timid. In a world where business has become not only lightning fast, but also increasingly fluid, he said, “…the biggest risk is perpetuating the status quo.” Success depends on willingness to move fast, be decisive, and take calculated […]

     

  6.  

    VMware Feature Walkthrough: Step-by-Step VMware How-to’s (http://blogs.vmware.com/vsphere/?p=13768)If you are like me, VMworld 2014 in San Francisco left my brain on overload. With so many new product and services announcements, plus breakout sessions filled with technical information and demos in the expo floor booths, it’s hard not to feel like you are drinking from the proverbial fire hose.  Throw in a party […]

     

  7.  

    VMware Virtual SAN Network Design Guide (http://blogs.vmware.com/vsphere/?p=13783)Virtual SAN is a scale-out hypervisor-converged software-defined storage solution that can scale up to 32 nodes in a cluster. The network serves as the backbone of a Virtual SAN cluster by providing the interconnects between nodes via an Ethernet network topology. There are many design options when creating a vSphere network design that includes VMware […]

     

  8.  

    VMware Hands-on Labs VMworld 2014 US online (http://blogs.vmware.com/vsphere/?p=13760)VMware Hands-on Labs at VMworld 2014 US marked a number of firsts: Over 10,000 labs were taken Over 100,000 VMs were used for labs during the week VSAN and EVO:RACK were used to host a portion of the infrastructure vCloud Air and Horizon 6 were in the top 5 labs I am pleased to announce […]

     

  9.  

    Virtual SAN 5.5 Validation Guide (http://blogs.vmware.com/vsphere/?p=13737)Enabling Virtual SAN, if the environment is configured and ready, is an easy click of the mouse. If the environment is not ready however, the task of troubleshooting a new product, can easily become quite daunting. As we track the issues that have arisen during Virtual SAN deployments, we see that the majority of issues […]

     

  10.  

    VMware Virtual SAN: Performance with Microsoft SQL Server (http://blogs.vmware.com/vsphere/?p=13731)As we continue to showcase the value and capabilities of Virtual SAN, I believe it is crucial to provide access to the information VMware’s performance engineering team has gathered around business critical applications and their respective performance benchmarks. This new white paper focuses on Microsoft SQL Server workload performance on VMware Virtual SAN. The study was […]

     

  11.  

    VCDX / vExpert Party Celebrates Programs, Honors Award Winners (http://blogs.vmware.com/education/?p=4642)It was the beginning of a new certification era and the end of an old one at the annual VMworld VCDX / vExpert party last week. Pat Gelsinger presented John Arrasjid, VCDX 001 with the John Newman Award, and Ray Budavari with the first ever VCIX-NV certification. Ray paved the way for recognition in installing, […]

     

  12.  

    Upcoming Webinar on VMware vCloud Automation Center (http://blogs.vmware.com/education/?p=4662)When properly understood, the vCloud Automation Center moves the task of delivering personalized IT services from a manual process to an automatic one. In our webinar on September 10th at 9am PDT, VCI and Senior Technical Instructor Jerry Davis will instruct participants on mastering: The use case for the vCloud Automation Center architecture within today’s […]

     

  13.  

    Save 50% on Two BETA Training Classes in the USA (http://blogs.vmware.com/education/?p=4632)We are offering two special beta delivery classes in the coming weeks. VMware offers BETA courses to anyone wanting to participate in finalizing the near complete course. You save 50% off the course price and get the same valuable VMware training. VMware NSX for Internetworking Experts Fast Track [V6.0] Reston, VA, USA 22-26 September This […]

     

  1.  

    Using Differentiated Services to Tame Elephants (http://blogs.vmware.com/networkvirtualization/?p=1507)This post was co-authored by Justin Pettit, Staff Engineer, Networking & Security Business Unit at VMware, and Ravi Shekhar, Distinguished Engineer, S3BU at Juniper Networks. ******************** As discussed in other blog posts and presentations, long-lived, high-bandwidth flows (elephants) can negatively affect short-lived flows (mice). Elephant flows send more data, which can lead to queuing delays for latency-sensitive mice. VMware […]

     

  2.  

    Running Microsoft SharePoint FAST Search on vSphere (http://blogs.vmware.com/consulting/?p=1542)By Girish Manmadkar I recently worked with an enterprise customer to resolve end user reports of performance issues related to Microsoft SharePoint 2010 and FAST Search deployed on vSphere 5.1. The end users were reporting problems with initial page response and file upload and download. The customer requested architecture guidance, including a performance health check […]

     

  3.  

    Calling all DevOps, resources are here for integrations (http://blogs.vmware.com/management/?p=4549)VMware provides a rich set of APIs and extensibility surfaces through which developers, devops engineers can rapidly develop cloud management solutions that integrate seamlessly with the latest VMware technologies for cloud automation and cloud operations. VMware Developer Center’s new Cloud Management and Automation zone gives you a single starting point for accessing the information and […]

     

  4.  

    There’s More to SaaS Than Meets the Eye (http://blogs.vmware.com/vcloud/?p=4229)This is a guest post from iland, a member of the vCloud Air Network. SaaS companies are really hot. Everyone is offering everything as a service – from applications to IT management itself, and everything in between. While we love to talk about the model in terms of Salesforce.com’s success, the growth of ServiceNow, or […]

     

  5.  

    The Case for SAP Central Services and VMware Fault Tolerance (http://blogs.vmware.com/apps/?p=1020)What’s the CPU Utilization Of Standalone SAP Central Services in a Virtual Machine? Since VMware came out with VMware Fault Tolerance (FT) we have considered the deployment option of installing SAP Central Services in a 1 x vCPU virtual machine protected by VMware FT. FT creates a live shadow instance of a virtual machine that […]

     

DESKTOP

  1.  

    Options for Application Delivery in VMware Horizon 6 (http://blogs.vmware.com/euc/?p=6362)By Cindy Heyer, Technical Writer, Technical Marketing, End-User Computing at VMware When it comes to application delivery, VMware Horizon 6.0 has something for everyone. VMware just published Application-Delivery Options in VMware Horizon 6.0, a white paper that describes the unique combination of application-delivery options supported in VMware Horizon 6.0. Today’s workforce is extremely fluid. Employees […]

     

  2.  

    Finalists announced for AirWatch Enterprise Mobility Excellence Awards (http://blogs.air-watch.com/?p=31637)Drumroll please… The following organizations have been named finalists for the AirWatch Enterprise Mobility Excellence Awards in North America. Operational Excellence (ROI) Awards, Non-profit/Education Coachella Valley Unified School District Indiana University of Pennsylvania Saint Francis High School Operational Excellence (ROI) Awards, Business Athenahealth Monsanto Ontario Tire Stewardship Mobile Innovation Award, Customers News America Marketing QuickPass (a division […]

     

  3.  

    Enterprise mobility news recap: Sept. 1 – 5 (http://blogs.air-watch.com/?p=31625)Mobile technology is changing by the minute; sometimes you just can’t catch it all. Here’s what you might have missed this week: AirWatch Connect is next week! Find out all you need to know before the leading event in enterprise mobility at http://air-watch.com/connect/. Virtual reality is making strides. Oculus Rift has teamed up with Samsung […]

     

  4.  

    Dolce Hotels: Modernizing through mobility (http://blogs.air-watch.com/?p=31460)Guests staying at any of the 24 Dolce Hotels and Resorts will notice a common theme: quality. The characteristic is ingrained into each location and every aspect of operation. Even those behind the scenes are committed to quality. For VP of IT John Edwards, quality is defined by innovation through technology. The IT staff at […]

     

PARTNER

  1.  

    New VMware | HP Video Highlighting Strategy for an Open SDDC (http://blogs.vmware.com/partnernews/?p=1323)This new, 3-minute video, describes the VMware | HP strategy, co-development activities, and joint go-to-market plans for VMware vCenter and HP OneView integration. The collaboration will enable your customers to take their SDDC to the next level, by abstracting compute, storage, and networking and managing it all from a  single console. 

     

  2.  

    EMC Forum… 39 Cities Left to Redefine (http://blogs.vmware.com/partnernews/?p=1321)We are the diamond sponsor of the EMC Forum 2014 road show. Bring your customers to your city to learn more about the joint VMware | EMC value propositions.

     

  3.  

    VMware Fusion 7 Pro Now Available (http://blogs.vmware.com/partnernews/?p=1319)Fusion 7 Pro is now available to sell or upgrade. This product lets advanced users and developers run Windows on Macs and opens the door to Macs in business. It also connects to and runs VMs hosted on vSphere.

     

  4.  

    Just 2 Months Left to Comply with New Competency Requirements (http://blogs.vmware.com/partnernews/?p=1317)Solution Provider and Service Provider program changes – requiring 2 individuals trained in Solution Competency-specific VSP and VTSP accreditations – are now in effect and these new requirements must be met by November 3, 2014. Get started with the online Solution Competency training now.

     

  5.  

    EUC Series: Trend to Watch and Ways VMware Partners are Changing IT History (http://blogs.vmware.com/partner/?p=2143)Sixty to seventy years ago it was the mainframe. Twenty to thirty years ago: client-server. In present day, mobile and cloud are the hot topics in every IT department. In fact, mobile and cloud are growing four times faster than the rest of the IT sector, according to a report from Gartner. With more and […]

     

VERTICALS

  1.  

    Learn How to Make the Most Important Data Center Decisions at VMware SMB September Webcasts (http://blogs.vmware.com/smb/?p=3008)This September, join VMware for our free, upcoming live and on-demand webcasts to learn how to make important IT decisions for your SMB. Learn how to deliver the best IT performance with the least manual effort during our virtual infrastructure webcast. Discover why VMware Virtual SAN is the industry leader in hyper-converged, software-defined storage for […]

     

  2.  

    Three Keys to Fast, Affordable IT in an Always-On World (http://blogs.vmware.com/smb/?p=3004)In today’s data centers, three trends drive the need for new approaches to the management of IT systems: the expectation for always-on IT services, rapidly growing infrastructure, and limited IT budgets. While any one of these trends creates challenges for your IT team, the combination of them makes it clear that the status quo is […]

     

EXTERNAL BLOGGERS

  1.  

  2.  

  3.  

  4.  

  5.  

  6.  

    Re: Re: The Rack Endgame: A New Storage Architecture For the Data Center (http://www.yellow-bricks.com/?p=15368)I was reading Frank Denneman’s article with regards to new datacenter architectures. This in its turn was a response to Stephen Fosket’s article about how the physical architecture of datacenter hardware should change. I recommend reading both articles as that will give a bit more background, plus they are excellent reads by itself. (gotta love […] " Re: Re: The Rack Endgame: A New Storage Architecture For the Data Center " originally appeared on Yellow-Bricks.com . Follow me on twitter -…

     

  7.  

    VMware EVO:RAIL demo (http://www.yellow-bricks.com/?p=15359)I just wanted to share the VMware EVO:RAIL demo with my readers. I shared it on twitter / linkedin but figured it made sense as well to have it here. The demo shows both the configuration and the management interface. Note that it takes less than 15 minutes normally to complete the configuration, but of […] " VMware EVO:RAIL demo " originally appeared on Yellow-Bricks.com . Follow me on twitter - @DuncanYB. Pre-order my upcoming book Essential Virtual SAN via Pearson today!

     

  8.  

    VMware EVO:RAIL FAQ (http://www.yellow-bricks.com/?p=15332)Over the last couple of days the same VMware EVO:RAIL questions keep popping up over and over again. I figured I would do a quick VMware EVO:RAIL Q&A post so that I can point people to that instead of constantly answering them on twitter. Can you explain what EVO:RAIL is? EVO:RAIL is the next evolution […] " VMware EVO:RAIL FAQ " originally appeared on Yellow-Bricks.com . Follow me on twitter - @DuncanYB. Pre-order my upcoming book Essential Virtual SAN via Pearson today!

     

  9.  

    VMware / ecosystem / industry news flash… part 2 (http://www.yellow-bricks.com/?p=15268)There we go, part two of the VMware / ecosystem / industry news flash. I expected a lot of news around VMworld as traditionally is always the case. I hope the below is a good summary, these are the articles / announcements I read and found interesting. It is the Monday after VMworld and I […] " VMware / ecosystem / industry news flash… part 2 " originally appeared on Yellow-Bricks.com . Follow me on twitter - @DuncanYB. Pre-order my upcoming book Essential Virtual SAN via Pearson today!

     

  10.  

    Liking the VMware EVO:RAIL look? How about a desktop / phone wallpaper? (http://www.yellow-bricks.com/?p=15254)Dave Shanley (lead engineer for VMware EVO:RAIL) dropped me an email with an awesome looking wallpaper for desktops and smart phones. I asked him if I could share with the world and I guess it is needless to say what the answer was. Grab ‘em below while they are still hot :). Thanks Dave! Note, […] " Liking the VMware EVO:RAIL look? How about a desktop / phone wallpaper? " originally appeared on Yellow-Bricks.com . Follow me on twitter - @DuncanYB. Pre-order my upcoming book Essential Virtual…

     

  11.  

    Infinio now supports block storage (http://vsphere-land.com/?p=4895)While at VMworld I had the opportunity to meet the folks from Infinio and have dinner with them. One of their big announcements at VMworld was around something that I had always thought was really holding them back from growing their business. Their original Infinio Accelerator 1.0 product which was released last year only supported … Continue reading »

     

  12.  

    Introducing vSphere-land 2.0! (http://vsphere-land.com/?p=4884)I’ve been wanting to upgrade both my WordPress version and theme for a long time now but have been hesitant because I have a lot of plug-ins, custom css and theme hacking that I’ve done and I didn’t want to break anything. Well this weekend GoDaddy gave me a reason to. I’ve hosted my sites … Continue reading »

     

  13.  

    Commodity off the Shelf… Cheaper? (http://virtualgeek.typepad.com/virtual_geek/2014/09/commodity-of-the-shelf-cheaper.html)It’s an interesting thing that I’ve been seeing more and more – customers looking to leverage commodity off the shelf hardware and opensource software stacks. Personally, I LOVE this idea. I think that “Software Defined” means that whenever you CAN...

     

  14.  

    Technology Short Take #44 (http://blog.scottlowe.org/?p=3509)This is Technology Short Take #44, the latest in my irregularly-published series of content links and thoughts on various data center-related technologies. This article was originally posted on blog.scottlowe.org . Visit the site for more information on virtualization, servers, storage, and other enterprise technologies. Technology Short Take #44

     

  15.  

    VMworld 2014 Orchestration, Automation & Optimization Panel (http://www.virtu-al.net/?p=3221)One of the highlights for VMworld 2014 in San Francisco this year for me was on the first day, I was asked by the vBrownbag team to sit on the “Opening Acts 2014 Orchestration,... VMworld 2014 Orchestration, Automation & Optimization Panel is a post from: Virtu-Al . Virtu-Al is one of the authors of VMware vSphere PowerCLI Reference: Automating vSphere Administration" Buy it now from: Amazon USA Amazon UK Sybex

     

  16.  

    WebCommander goes Open Source (http://www.virtu-al.net/?p=3212)You may have heard me talk about Webcommander before at VMworld or during a vBrownbag, if you haven’t and you don’t know about this project then you have been missing out! WebCommander was designed... WebCommander goes Open Source is a post from: Virtu-Al . Virtu-Al is one of the authors of VMware vSphere PowerCLI Reference: Automating vSphere Administration" Buy it now from: Amazon USA Amazon UK Sybex

     

  17.  

    EMC – RecoverPoint for Virtual Machines (http://www.penguinpunk.net/blog/?p=2242)EMC announced RecoverPoint for VMs last week, and I thought I’d do a quick summary post / highlights for those who missed it. Firstly, an overview from EMC can be found here. You can get the datasheet here. And you can watch an overview video of the features here. Audience Secondly, it’s important to understand […]

     

  18.  

    VMware – EVO:RAIL – Link-o-rama (http://www.penguinpunk.net/blog/?p=2238)The past week is a bit of a blur. While I re-adjust to GMT +10, I thought I’d put out a quick post with links to various useful resources on VMware’s EVO:RAIL. Firstly, here’s some from VMware that provide a nice overview of the product. EVO:RAIL Datasheet Introductory Whitepaper Duncan has a typically comprehensive post on […]

     

  1.  

    VMware Fling – View Auditing Portal (http://www.vmguru.nl/?p=13600)Today VMware Labs released a new fling, the View Auditing Portal which is a new web portal that serves  as an extension to Horizon View Administrator. View Auditing Portal features: Show parent virtual machines of linked clone desktop pools and descendant snapshots in a tree view. The snapshots not in use by linked clone pools are marked in grey,  so that View administrator can remove the snapshots not in use. Show statistics for operation systems and versions of View clients in different types of view…

     

  2.  

    VMware Fusion 7 released (http://www.vmguru.nl/?p=13583)Just moments ago VMware has released VMware Fusion 7, their personal desktop virtualization software for the Mac. VMware Fusion 7 is optimized for the latest Macs and ready for OS X Yosemite and Windows 8.1. Designed for OSX Yosemite With Fusion 7 you will be able to get a Mac-like experience when running Windows applications on a Mac. The Fusion 7 updated Yosemite look and feel makes working with your Windows applications feel cleaner and more refined. Adopting Yosemite’s key design cues such as…

     

  3.  

    Who runs Horizon 6 more efficiently? Nutanix or VSAN? (http://myvirtualcloud.net/?p=6586)One great aspect of working for a cutting edge storage vendor such as Nutanix is that for all of the competitive sniping in the marketplace, the technology really does speak for itself. A question that was asked of me recently by an individual new to SDS had me thinking about the traits that make solutions … Continue reading »

     

  4.  

    Secure Content Sharing And Messaging with End to End Security – Places from Reunion Island (http://www.vladan.fr/?p=36513)I was quite surprised by discovering this new startup from Reunion Island – an Island where I live, trying to solve quite painful problem these days – privacy and security for individuals. What if the way to go to the personal security and privacy lead through our own protection, without letting the others spy at our data [...] Read the full post Secure Content Sharing And Messaging with End to End Security – Places from Reunion Island at ESX Virtualization .

     

  5.  

    VMware Virtual SAN 5.5 Validation Guide (http://www.vladan.fr/?p=36500)This guide helps to do a check of VSAN requirements before and after deployment. VMware engineers used this document internally first in order to validate the VSAN requirements before hitting the “enable VSAN” checkbox. It allows some head scratching on “why am I getting this error?”. If you go through and successfully validate all the [...] Read the full post VMware Virtual SAN 5.5 Validation Guide at ESX Virtualization .

     

  6.  

    VMware Fusion 7 and Fusion 7 Pro released – ready for Yosemite (http://www.vladan.fr/?p=36493)New version of VMware Fusion 7 and Fusion 7 Pro version has been released yesterday bringing more efficiency (up to 46% compared to Fusion 6), more performance and more features. Fusion Pro version can run a greater range of operating systems (over 200) and has a supports for iSight cameras in VMs. It can also connect [...] Read the full post VMware Fusion 7 and Fusion 7 Pro released – ready for Yosemite at ESX Virtualization .

     

  7.  

    Free Tool for Nested ESXi Labs – ESXi Mac Learning dvFilter (http://www.vladan.fr/?p=36477)There is a free utility called ESXi MAC learning dvFilter released by VMware Labs last week. This utility is provided as a VIB and installs on the physical ESXi host, not on the virtual ESXi hosts. I learned about it by reading posts from William Lam and Andreas Peetz. ESXi Mac Learning dvFilter is kind of [...] Read the full post Free Tool for Nested ESXi Labs – ESXi Mac Learning dvFilter at ESX Virtualization .

     

  8.  

    Backup and Restore ESXi Configuration with PowerCLI (http://www.vladan.fr/?p=36430)In some situations you might need to backup or restore configuration of your ESXi host. This can be done with several tools with GUI front end or you can use tools diretly built-in ESXi and vSphere. And that’s what we will explore today. There might be a situation where the only choice is what you already have [...] Read the full post Backup and Restore ESXi Configuration with PowerCLI at ESX Virtualization .

     

  9.  

    EVO: RAIL Demo Video – VMware Hyper-Converged Infrastructure (http://www.vladan.fr/?p=36463)Before VMworld I have assisted to VMware EVO: RAIL presentation. VMware Hyper-Converged infrastructure presentation video wasn’t available to the public until today, when Duncan Epping has published the video done by Dave Shanley. So here is EVO: RAIL Demo Video. VMware EVO:RAIL has been demoed during VMworld and I have also published a details, together with [...] Read the full post EVO: RAIL Demo Video – VMware Hyper-Converged Infrastructure at ESX Virtualization .

     

KB ARTICLES

 

VMware ESX
VMware ESXi 5.0, Patch ESXi500-201408402-BG: Updates tools-light (2080819)
Date Published: 8/28/2014
VMware ESXi-5.0, Patch ESXi-5.0.0-20140804001-standard (2080821)
Date Published: 8/28/2014
VMware ESXi
Determining the BIOS, hardware, and driver versions of an ESXi 5.x host through the Web browser (2075270)
Date Published: 8/26/2014
VMware ESXi 5.0, Patch ESXi500-201408401-BG: Updates esx-base (2080816)
Date Published: 8/28/2014
VMware ESXi 5.0, Patch ESXi-5.0.0-20140804001-no-tools (2080825)
Date Published: 8/28/2014
VMware ESXi 5.0, Patch ESXi-5.0.0-20140801001s-no-tools (2080836)
Date Published: 8/28/2014
Understanding ESXi 5.x Patching Model (2083707)
Date Published: 8/26/2014
Changing the ESXi server management IP address (2084629)
Date Published: 8/27/2014
ESXi 5.5.x host fails with a purple diagnostic screen and reports the error: Res3GetSpecificCluster@esx (2086747)
Date Published: 8/28/2014
VMware ESXi 5.0, Patch ESXi500-201408101-SG: Updates esx-base (2080829)
Date Published: 8/28/2014
VMware ESXi 5.0, Patch ESXi-5.0.0-20140801001s-standard (2080833)
Date Published: 8/28/2014
VMware ESXi 5.0, Patch Release ESXi500-201408001 (2080838)
Date Published: 8/28/2014
Cannot log in to the ESXi host using Active Directory domain credentials (2087485)
Date Published: 8/27/2014
What does VMK_VECTOR mean? (2070218)
Date Published: 8/28/2014
VMware Horizon View
Deploying View Linked Clones from single parent image to multiple vLANs (2086437)
Date Published: 8/25/2014
Increasing the number of failed user login attempts displays the error: The View Connection Server authentication failed. Maximum login attempts exceeded (2086682)
Date Published: 8/26/2014
On Windows XP View clients connected to a Windows XP remote desktop, characters using the Japanese font MS Mincho do not print correctly (2085085)
Date Published: 8/30/2014
Health Management on two security servers flips from green to red and reports the error: The service is not working properly (2087822)
Date Published: 8/29/2014
VMware Horizon Workspace
Installing a custom SSL certificate in VMware Horizon Workspace 1.x fails when using an encrypted RSA Private Key (2063732)
Date Published: 8/25/2014
VMware Horizon Workspace reports virtual appliance (vApp) with host name as localhost.localdomain (2084687)
Date Published: 8/28/2014
Installing the VMware Workspace Portal fails with the error: The operation is not supported on this object. (2086526)
Date Published: 8/27/2014
VMware vCenter Configuration Manager
Patch deployment fails for some Linux managed machines, such as CentOS and OEL, when SELinux is enabled on the managed machine (2079311)
Date Published: 8/27/2014
VMware vCenter Orchestrator
VMware vCenter Orchestrator appears twice in vSphere Web Client, as FQDN and IP address (2076318)
Date Published: 8/25/2014
VMware vCenter Server
Users or groups are unable to log in to vCenter Server after restarting the VMware VirtualCenter Server service (2086548)
Date Published: 8/26/2014
VMware vCenter Server indicates that the Dynamic Resource Scheduler (DRS) usage load is imbalanced (2087250)
Date Published: 8/27/2014
Using a Service Principle Name for Active Directory authentication in vCenter Single Sign-On 5.5 uses the Machine Account (2087978)
Date Published: 8/28/2014
Cannot start vCenter Server after applying a Windows patch (2075117)
Date Published: 8/27/2014
VMware vCenter Server Appliance
SNMP Collector displays source address as 127.0.0.1 in a VMware vCenter Server Appliance (2085359)
Date Published: 8/26/2014
VMware vCenter Site Recovery Manager
Cannot perform Recoveries in VMware vCenter Site Recovery Manager (SRM) with SRM Administrator role (2085375)
Date Published: 8/27/2014
VMware vCloud Application Director
The virtual appliance (vApp) reports the hostname as locahost.localdomain when deploying in VMware vCloud Application Director (2079768)
Date Published: 8/26/2014
VMware vCloud Director
Changing the vApp Network NAT mapping mode to manual and set an external IP in VMware vCloud Director 5.5.1 fails with the error: Invalid IP address for the external network (2085601)
Date Published: 8/28/2014
The VMware vCloud Director (vCD) webapp fails to start with the error: Missing: com.vmware.vcloud.ui-vcloud-webapp (2052230)
Date Published: 8/27/2014
VMware vSphere Data Protection
VMware vSphere Data Protection (VDP) manual and scheduled backups do not start (2069729)
Date Published: 8/29/2014
VMware vSphere Storage Appliance
Changing the vCenter Server IP address in the VMware vSphere Storage Appliance cluster (2076495)
Date Published: 8/25/2014
Reconfiguring network settings in VMware vSphere Storage Appliance (VSA) 5.5 (2086680)
Date Published: 8/26/2014

VMware Newsletter 6.36

$
0
0

From the editors virtual desk

Hi everyone, well this is it, my first newsletter from a very sunny San Francisco. I arrived last week and have been spending my time trying to get settled. It has been very smooth up to now, no real issues at all. Everything here works as advertised and I am just getting my bearing on where everything is and how to work the public transport system.

For those that may have missed my latest blog posting here is another link to it. I plan a follow up for you for next week as well and will try and make this a regular weekly update or as often as possible.

Why do we still build Virtual Machines like their Physical Counterparts

Link to blog post - http://tinyurl.com/mn4pft4

I have been a bit out of the loop for the past week due to my travels so I too am catching up on VMware related news via the newsletter so I will keep things short this week and let you get on with reading all about the VMware world below.

Any feedback of course please feel free to get in contact with me anytime.

I look forward to chatting to you again next week.

Virtually Yours

Neil Isserow

Staff Technical Account Manager

VMware Inc - San Francisco, CA

nisserow @ vmware . com

 

LOCAL TRAINING CLASSES

http://tinyurl.com/m4wmen5 for full list

Highlights:

VMware vCloud Networking and Security for vSphere Professionals [V5.5] 06-08 Oct

VMware vSphere: What's New [V4.x to V5.5] 09-10 Oct

VMware vCenter Operations Manager: Analyze and Predict [V5.x] 13-15 Oct

VMware vCenter Operations Manager: Advanced Usage and Dashboard Design [V5.x] 15-17 Oct

VMWARE BLOGGERS

KB ARTICLES

 

VMware ESX

Understanding the differences between snapshots and delta files, snapshot deletion and consolidation (2078993)

Date Published: 9/12/2014

HA slot size calculation becomes distorted when using VMware strict admission control and reports the error: Insufficient Resources for HA failover (2015564)

Date Published: 9/10/2014

VMware ESXi

Generated Core dump file gets deleted after experiencing the purple diagnostic screen on the ESXi host after 11 days (2089410)

Date Published: 9/12/2014

VMware ESXi 5.5 Complete Update 2 (2079725)

Date Published: 9/9/2014

Updates ESXi 5.5 sata-ata-piix vib (2084600)

Date Published: 9/9/2014

Concurrent virtual machine migrations using XvMotion fail with the error: A General System Error occurred (2088561)

Date Published: 9/8/2014

Applying the Host Profile settings on an ESXi host using vSphere Auto Deploy fails with the error: Host Profile execution failed: ‘Balanced’ CPU policy not supported by system (2088461)

Date Published: 9/9/2014

VMware ESXi 5.1.x host fails with a purple diagnostic screen and reports the error: PANIC bora/vmkernel/main/dlmalloc.c:4827 – Usage error in dlmalloc – TcpipAllocPort (2088300)

Date Published: 9/8/2014

Updates ESXi 5.5 esx-base vib (2079726)

Date Published: 9/9/2014

Updates ESXi 5.5 tools-light vib (2079727)

Date Published: 9/9/2014

Updates ESXi 5.5 net-tg3 vib (2079728)

Date Published: 9/9/2014

Updates ESXi 5.5 sata-ahci vib (2079729)

Date Published: 9/9/2014

Updates ESXi 5.5 scsi-megaraid-sas vib (2079730)

Date Published: 9/9/2014

Updates ESXi 5.5 esx-base vib (2079731)

Date Published: 9/9/2014

Updates ESXi 5.5 Image Profile-Standard (2079732)

Date Published: 9/9/2014

Updates ESXi 5.5 Image Profile-no-tools (2079735)

Date Published: 9/9/2014

Updates ESXi 5.5 Image Profile-Standard (2079736)

Date Published: 9/9/2014

Updates ESXi 5.5 Image Profile-no-tools (2079737)

Date Published: 9/9/2014

Updates ESXi 5.5 misc-drivers vib (2081032)

Date Published: 9/9/2014

Known limitations of the Intel® Xeon® processor E5 v3 series with ESXi 5.1.x and ESXi 5.5 Update 2 (2087032)

Date Published: 9/9/2014

After a purple diagnostic screen failure, ESXi host reports the warning: No coredump target has been configured. Host core dumps cannot be saved. (2088669)

Date Published: 9/9/2014

VMware Horizon View

VMware Horizon View trending issues by product version (2089340)

Date Published: 9/12/2014

The “Use native NFS snapshots (VAAI)” option is not available when you rebalance View virtual machines to an NFS datastore in vSphere 5.1 or later (2088995)

Date Published: 9/10/2014

After upgrading Horizon Client for Windows, cannot launch the client unless I run it as an administrator (2084817)

Date Published: 9/12/2014

VMware ThinApp

Virtual Internet Explorer does not redirect to the native browser for URLs that not in ThinDirect.txt. (2087898)

Date Published: 9/10/2014

Virtual version of Citrix v11.150 client launches the native Citrix Receiver instead of the virtual Citrix client. (2087931)

Date Published: 9/9/2014

VMware vCenter Operations Manager (vApp)

Definitions of Total Disk Space Configured and the Disk Space Total Used metrics in the Virtual Machine List report (2080111)

Date Published: 9/9/2014

VMware vCenter Orchestrator

VMware vCenter Orchestrator 5.x (vCO) High Availability (2079967)

Date Published: 9/9/2014

VMware vCenter Server

Managing vCenter Server Database Space Requirements (2078305)

Date Published: 9/9/2014

Unable to create virtual machine on a host when vCenter Server is installed with Oracle 12c database (2079443)

Date Published: 9/9/2014

Tagging the Stateless Caching Disk using Autodeploy displays an inaccurate Is Local: value (2088239)

Date Published: 9/11/2014

Executing long running custom VMware tools scripts for power off or suspend tasks fail with the error: A general system error occurred: Invalid Fault (2088472)

Date Published: 9/10/2014

VMware vCenter Server 5.5 – VIMPatch-5.5.0-2105955-20140901 (2077090)

Date Published: 9/9/2014

VMware vCenter Site Recovery Manager

Configuring CA signed certificates for VMware vCenter Site Recovery Manager (2085644)

Date Published: 9/9/2014

Operational Limits for Site Recovery Manager 5.8 (2081158)

Date Published: 9/9/2014

Network Ports for Site Recovery Manager 5.8 (2081159)

Date Published: 9/9/2014

Operational Limits of Site Recovery Manager 5.8 in a Shared Recovery Site (N:1) Configuration (2081866)

Date Published: 9/9/2014

VMware vCloud Automation Center

Cannot find VMware vSphere virtual machines by unique identifier using the vCenter Orchestrator Plug-in for VMware vCloud Automation Center 6.1 or directly in vSphere API (2088838)

Date Published: 9/9/2014

Installing vCloud Automation Center 6.1 (2088128)

Date Published: 9/11/2014

Migrating to vCloud Automation Center 6.1 from 5.2.x (2088136)

Date Published: 9/9/2014

Upgrading to VMware vCloud Automation Center (vCAC) 6.1 from 6.0 (2088132)

Date Published: 9/9/2014

The VMware vCloud Automation Center (vCAC) Windows Guest Agent fails to process assigned jobs and the gugent-axis.log file reports the error: Client certificate chain file not specified (2068820)

Date Published: 9/12/2014

vCloud Automation Center Release 6.1 Hotfix for NSX (2088172)

Date Published: 9/9/2014

VMware vCloud Connector

Copying the VMX10 virtual machine using the vCloud Connector fails with the error: Invalid configuration for device deviceID (2079424)

Date Published: 9/8/2014

VMware vCloud Director

When uploading files to ESXi hosts, VMware vCloud Director reports the error: A specified parameter was not correct (2078709)

Date Published: 9/11/2014

VMware vCloud Hybrid Service

Checking VMware Virtual Data Center (vDC) memory overhead in VMware vCloud Hybrid Service (2064099)

Date Published: 9/9/2014

VMware View

Connecting all USB devices to the VMware Horizon View desktop on launch (2088705)

Date Published: 9/12/2014

VMware vSphere Data Protection

Cancelling a job using the command line interface in vSphere Data Protection (VDP) (2088473)

Date Published: 9/10/2014

VMware vSphere Replication

Retrieving the Connection Details Required for Configuring Replications to Cloud (2083867)

Date Published: 9/9/2014

Resetting the MAC Address of a Virtual Machine that is Replicated to Cloud (2086292)

Date Published: 9/9/2014

Port Numbers that must be open for vSphere Replication 5.8 (2087769)

Date Published: 9/9/2014

Operational Limits for vSphere Replication 5.8 (2087771)

Date Published: 9/9/2014

DISCLAIMER

While I do my best to publish unbiased information specifically related to VMware solutions there is always the possibility of blog posts that are unrelated, competitive or potentially conflicting that may creep into the newsletter. I apologise for this in advance if I offend anyone and do my best to ensure this does not happen. Please get in touch if you feel any inappropriate material has been published. All information in this newsletter is copyright of the original author. If you are an author and wish to no longer be used in this newsletter please get in touch.

Supported Databases for vCenter Server for Windows

$
0
0

Hi All, Please find the attachment to check Supported Databases for vCenter Server for Windows. -Suresh


vSphere VM Hotplug functionality confuses AD GPO and locks out non system drives

$
0
0

I was asked to look at an issue on a customer account where when a server VM, used as a XenApp Dynamic Desktop server is moved from Computers OU to the desired destination OU and gpupdate run then suddenly the D and E drives were inaccessible.  They could be seen in “My Computer” and also in “Disk Management” but only listed as NTFS and no used/free space in My Computer, despite me having admin rights.

 

Obviously this had to be caused by policy as that’s the difference between moving the VM into the new OU and running gpupdate.

 

I reviewed the policies, there weren’t a vast number, but none appeared to have anything about locking down local fixed drives.

The key word there is FIXED.  There was a setting in one GPO under the section

Administrative Templates/System/Removable Storage Access

For

All Removable Storage classes: Deny all access

Which was to lock down USB drives etc.

 

But these were fixed drives……………..or were they?

Well this is where VMware is clever and Windows isn’t quite caught up, or you might argue VMware is TOO clever.

The SCSI controller provided by VMware is detected as hotplug.  You can confirm this by going to the system tray and clicking the eject/remove drive icon

sg

Fortunately as it booted from it C isn’t able to be ejected, but the other drives were therefore seen as removable storage and locked down.

 

Two solutions presented here.  One is change the GPO.  This is a VM on a host in a secure data center.  No-one’s plugging a USB into that host and mapping it to the VM via vCenter or Directpath any time soon.

 

However there is a VMware workaround.  You can disabled the hotplug functionality of the scsi controller driver.  Thereby “un-confusing” Windows.

Simply edit the VM configuration under the settings options/general/configuration parameters and add the setting

disable.hotplug and set the value to false

as described here.

VMware KB: Disabling the HotAdd/HotPlug capability in ESXi 5.x and ESXi/ESX 4.x virtual machines

 

And a reboot later and Windows now knows these aren’t removable drives and all is well with the world

vSphere 5.5 U2- Edit vmx-10 with vSphere Windows Client

$
0
0

Just for your information. We will now be able to edit  the Virtual Machine properties with Hardware version (vmx-10)  from the vSphere Windows Client (5.5 Update 2). You need to install the latest vSphere Client -Suresh

vSphere で Hadoop してみる。BDE 第5回

$
0
0

今回は、前回までに vSphere Big Data Extensions(BDE)で作成した

Hadoop 環境を、もう少し見てみようと思います。

そして、かるく WordCount してみます。


これまでの流れは・・・

vSphere で Hadoop してみる。(Big Data Extentions) 第1回

vSphere で Hadoop してみる。BDE 第2回

vSphere で Hadoop してみる。BDE 第3回

vSphere で Hadoop してみる。BDE 第4回


BDE で構築した Hadoop 環境について


Client ノードとして作成された VM に SSH でログインして確認してみます。

※Client 以外の、マスタ / スレーブ ノードも同様の構成になります。

bde-trywc-01.png

 

Hadoop クラスタに作成されたノードは、

CentOS 6.4 64bit です。

[root@192 ~]# cat /etc/centos-release

CentOS release 6.4 (Final)

[root@192 ~]# uname -r

2.6.32-358.el6.x86_64

 

IP アドレスが、そのままホスト名になっています。

[root@192 ~]# uname -n

192.168.5.124

 

Java は、Oracle (Sun)の HotSpot 1.7.0_51 でした。

[root@192 ~]# /usr/java/default/bin/java -version

java version "1.7.0_51"

Java(TM) SE Runtime Environment (build 1.7.0_51-b13)

Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode)

 

Apache Hadoop のバージョンは、1.2.1 です。

[root@192 ~]# hadoop version

Hadoop 1.2.1

Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1503152

Compiled by mattf on Mon Jul 22 15:23:09 PDT 2013

From source with checksum 6923c86528809c4e7e6f493b6b413a9a

This command was run using /usr/lib/hadoop-1.2.1/hadoop-core-1.2.1.jar

 

HDFS のマスターノード(NameNode)と

MapReduce のマスターノード(JobTracker)が

自動的に設定ファイルに記載されています。

※今回の IP アドレスは、DHCP で設定されたものです。

[root@192 ~]# grep -A1 "fs.default.name" /etc/hadoop/conf/core-site.xml

  <name>fs.default.name</name>

  <value>hdfs://192.168.5.128:8020</value>

[root@192 ~]# grep -A1 "mapred.job.tracker<" /etc/hadoop/conf/mapred-site.xml

  <name>mapred.job.tracker</name>

  <value>192.168.5.125:8021</value>

 

HDFS の操作をしてみる。

 

Client ノードから NameNode の URL を指定して HDFS を見てみます。

[root@192 ~]# hadoop fs -fs hdfs://192.168.5.128:8020 -ls /

Found 3 items

drwxrwxr-x   - hdfs hadoop          0 2014-09-17 23:11 /hadoop

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:14 /tmp

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:12 /user

[root@192 ~]# hadoop fs -fs hdfs://192.168.5.128:8020 -ls /tmp

Found 2 items

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:14 /tmp/hadoop-mapred

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:13 /tmp/hadoop-yarn

 

デフォルトの NameNode が設定してあるので、「-fs hdfs://~」は

省略しても HDFS にアクセスできます。

※ついでに HDFS にディレクトリを作成しています。

[root@192 ~]# hadoop fs -ls /tmp

Found 2 items

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:14 /tmp/hadoop-mapred

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:13 /tmp/hadoop-yarn

[root@192 ~]# hadoop fs -mkdir /tmp/test

[root@192 ~]# hadoop fs -mkdir /tmp/test/input

[root@192 ~]# hadoop fs -chmod -R 777 /tmp/test

[root@192 ~]# hadoop fs -lsr /tmp/test

drwxrwxrwx   - root hadoop          0 2014-09-21 23:22 /tmp/test/input

 

MapReduce ジョブ(サンプルの WordCount)を実行してみようと思うので、

HDFS にファイルをアップロードしておきます。

今回は、hadoop コマンドのヘルプを WordCount してみます。

[root@192 ~]# hadoop help > sample.txt

[root@192 ~]# head sample.txt

Usage: hadoop [--config confdir] COMMAND

where COMMAND is one of:

  namenode -format     format the DFS filesystem

  secondarynamenode    run the DFS secondary namenode

  namenode             run the DFS namenode

  datanode             run a DFS datanode

  dfsadmin             run a DFS admin client

  mradmin              run a Map-Reduce admin client

  fsck                 run a DFS filesystem checking utility

  fs                   run a generic filesystem user client

[root@192 ~]# hadoop fs -put ./sample.txt /tmp/test/input/

[root@192 ~]# hadoop fs -ls /tmp/test/input

Found 1 items

-rw-r--r--   3 root hadoop       1567 2014-09-21 23:37 /tmp/test/input/sample.txt

 

ちなみに、Web Client の BDE プラグインから、

おなじみの HDFS ステータス確認のページを表示することができます。

クラスタを右クリックして 「Open HDFS Status Page」をクリックすると・・・

bde-trywc-02.png

 

Web ブラウザで HDFS の NameNode のページが開きます。

bde-trywc-03.png

 

MapReduce ジョブの実行

 

サンプルアプリケーションの WordCount を実行してみます。

Client ノードに配置されている、

hadoop-examples-1.2.1.jar を使用します。

[root@192 ~]# ls -l /usr/lib/hadoop-1.2.1/hadoop-examples-1.2.1.jar

-rw-rw-r-- 1 hdfs hadoop 142726 Jul 22  2013 /usr/lib/hadoop-1.2.1/hadoop-examples-1.2.1.jar

 

それでは、MapResuce してみます。

先ほど、HDFS にアップロードした hadoop コマンドのヘルプを WordCount してみます。

[root@192 ~]# hadoop jar /usr/lib/hadoop-1.2.1/hadoop-examples-1.2.1.jar wordcount /tmp/test/input /tmp/test/output

14/09/21 23:38:47 INFO input.FileInputFormat: Total input paths to process : 1

14/09/21 23:38:47 INFO util.NativeCodeLoader: Loaded the native-hadoop library

14/09/21 23:38:47 WARN snappy.LoadSnappy: Snappy native library not loaded

14/09/21 23:38:49 INFO mapred.JobClient: Running job: job_201409172315_0006

14/09/21 23:38:50 INFO mapred.JobClient:  map 0% reduce 0%

14/09/21 23:39:27 INFO mapred.JobClient:  map 100% reduce 0%

14/09/21 23:39:49 INFO mapred.JobClient:  map 100% reduce 100%

14/09/21 23:39:50 INFO mapred.JobClient: Job complete: job_201409172315_0006

14/09/21 23:39:50 INFO mapred.JobClient: Counters: 29

14/09/21 23:39:50 INFO mapred.JobClient:   Job Counters

14/09/21 23:39:50 INFO mapred.JobClient:     Launched reduce tasks=1

14/09/21 23:39:50 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=28592

14/09/21 23:39:50 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0

14/09/21 23:39:50 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0

14/09/21 23:39:50 INFO mapred.JobClient:     Launched map tasks=1

14/09/21 23:39:50 INFO mapred.JobClient:     Data-local map tasks=1

14/09/21 23:39:50 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=22396

14/09/21 23:39:50 INFO mapred.JobClient:   File Output Format Counters

14/09/21 23:39:50 INFO mapred.JobClient:     Bytes Written=1081

14/09/21 23:39:50 INFO mapred.JobClient:   FileSystemCounters

14/09/21 23:39:50 INFO mapred.JobClient:     FILE_BYTES_READ=1552

14/09/21 23:39:50 INFO mapred.JobClient:     HDFS_BYTES_READ=1683

14/09/21 23:39:50 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=139783

14/09/21 23:39:50 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=1081

14/09/21 23:39:50 INFO mapred.JobClient:   File Input Format Counters

14/09/21 23:39:50 INFO mapred.JobClient:     Bytes Read=1567

14/09/21 23:39:50 INFO mapred.JobClient:   Map-Reduce Framework

14/09/21 23:39:50 INFO mapred.JobClient:     Map output materialized bytes=1552

14/09/21 23:39:50 INFO mapred.JobClient:     Map input records=30

14/09/21 23:39:50 INFO mapred.JobClient:     Reduce shuffle bytes=1552

14/09/21 23:39:50 INFO mapred.JobClient:     Spilled Records=234

14/09/21 23:39:50 INFO mapred.JobClient:     Map output bytes=1999

14/09/21 23:39:50 INFO mapred.JobClient:     Total committed heap usage (bytes)=200806400

14/09/21 23:39:50 INFO mapred.JobClient:     CPU time spent (ms)=4120

14/09/21 23:39:50 INFO mapred.JobClient:     Combine input records=192

14/09/21 23:39:50 INFO mapred.JobClient:     SPLIT_RAW_BYTES=116

14/09/21 23:39:50 INFO mapred.JobClient:     Reduce input records=117

14/09/21 23:39:50 INFO mapred.JobClient:     Reduce input groups=117

14/09/21 23:39:50 INFO mapred.JobClient:     Combine output records=117

14/09/21 23:39:50 INFO mapred.JobClient:     Physical memory (bytes) snapshot=270094336

14/09/21 23:39:50 INFO mapred.JobClient:     Reduce output records=117

14/09/21 23:39:50 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1282797568

14/09/21 23:39:50 INFO mapred.JobClient:     Map output records=192

 

ちなみに、Web Client の BDE プラグインから、

おなじみの MapReduce ステータス確認のページも表示することができます。

クラスタを右クリック → 「Open MapReduce Status Page」をクリックすると・・・

bde-trywc-04.png

 

Web ブラウザで Map/Reduce Administration ページが開きます。

bde-trywc-05.png

 

Running Jobs のあたりで、実行中のジョブを確認できたりします。

bde-trywc-06.png

 

ジョブが終了すると、ワードをカウントしたファイルが作成されます。

[root@192 ~]# hadoop fs -ls /tmp/test/output

Found 3 items

-rw-r--r--   3 root hadoop          0 2014-09-21 23:39 /tmp/test/output/_SUCCESS

drwxrwxrwx   - root hadoop          0 2014-09-21 23:38 /tmp/test/output/_logs

-rw-r--r--   3 root hadoop       1081 2014-09-21 23:39 /tmp/test/output/part-r-00000

[root@192 ~]# hadoop fs -get /tmp/test/output/part-r-00000 ./sample_wc.txt

[root@192 ~]# wc -l sample_wc.txt

117 sample_wc.txt  ★117ワードありました。

[root@192 ~]# head -n 20 sample_wc.txt

-archiveName    1

-format 1

-p      1

2       1

<dest>  1

<desturl>       2

<jar>   1

<parent 1

<src>*  1

<srcurl>        2

CLASSNAME       2

COMMAND 2

DFS     6

DistCp  1

Hadoop  1

JobQueues       1

Map-Reduce      1

MapReduce       3

Most    1

NAME    1

 

ちなみに、ヘルプには run というワードが多いですね。

[root@192 ~]# sort -k2 -n -r sample_wc.txt | head -n 20

run     14

the     12

a       12

DFS     6

namenode        4

job     4

version 3

jar     3

filesystem      3

client  3

MapReduce       3

utility 2

to      2

print   2

or      2

node    2

hadoop  2

get     2

fsimage 2

file    2

 

以上、BDE で構築した Hadoop 環境についてでした。

たぶん、まだ続けます・・・

vSphere で Hadoop してみる。BDE 第6回(Serengeti CLI)

vmwPAD ver 2.3.23 released

$
0
0

The following has been added

 

1. Android ART runtime support.

2. HTML5 VM Console (Only for vCenter. vSphere Web Client needs to be initialized and running. Android 4.1 or higher recommended).

 

More details here vmwPAD - Android Apps on Google Play

 

vmconsole.png

vSphere で Hadoop してみる。BDE 第6回(Serengeti CLI)

$
0
0

今回も、VMware と Hadoop の話です。

 

vSphere Big Data Extensions(BDE) のこれまでのポスト

PowerCLIでCPUアフィニティ設定(ESXi 5.x)

vSphere で Hadoop してみる。BDE 第2回

vSphere で Hadoop してみる。BDE 第3回

vSphere で Hadoop してみる。BDE 第4回

vSphere で Hadoop してみる。BDE 第5回

 

今回は、Serengeti CLI の話です。

BDE には、serengeti という CLI が用意されていて、

BDE の管理サーバ(management-server VM)に SSH でアクセスして

serengeti」 と実行すると、起動できます。

bde-serengeti-01.png

テキストだとこんな感じです。

[serengeti@192 ~]$ serengeti

=================================================

*  _____                                 _   _  *

* / ____|  ___ _ __ ___ _ __   __ _  ___| |_(_) *

* \____ \ / _ \ '__/ _ \ '_ \ / _` |/ _ \ __| | *

*  ____) |  __/ | |  __/ | | | (_| |  __/ |_| | *

* |_____/ \___|_|  \___|_| |_|\__, |\___|\__|_| *

*                             |___/             *

*                                               *

=================================================

Version: 2.0.0

Welcome to Serengeti CLI

serengeti>

 

BDE 管理サーバのサービス(localhost:8443)に接続することで

vSphere BDE 環境の Hadoop を確認したり、操作したりすることができます。

※ここのログインは、Web Client と同様に、vCenter SSO の認証を利用しています。

serengeti>connect --host localhost:8443

Enter the username: vmad\administrator ※vCenterSSOの認証でログイン

Enter the password: **********

Connected

 

たとえば、前回までに作成した Hadoop クラスタを表示してみます。

serengeti>cluster list --name hdp_cluster01

  ============================================================================

 

  CLUSTER NAME              :  hdp_cluster01

  AGENT VERSION             :  2.0.0

  DISTRO                    :  apache

  TOPOLOGY                  :  HOST_AS_RACK

  AUTO ELASTIC              :  N/A

  MIN COMPUTE NODES NUM     :  N/A

  MAX COMPUTE NODES NUM     :  N/A

  IO SHARES                 :  NORMAL

  STATUS                    :  RUNNING

 

  GROUP NAME     ROLES                                    INSTANCE  CPU  MEM(MB)  TYPE    SIZE(GB)

  ------------------------------------------------------------------------------------------------

  DataMaster     [hadoop_namenode]                        1         1    3748     SHARED  10

  ComputeMaster  [hadoop_jobtracker]                      1         1    3748     SHARED  10

  Worker         [hadoop_datanode, hadoop_tasktracker]    2         1    3748     SHARED  20

  Client         [hadoop_client, pig, hive, hive_server]  1         1    3748     SHARED  20

  ============================================================================

 

実際にターミナルで表示する場合はこのようになります。

bde-serengeti-02.png

 

このクラスタは、BDE の Web Client プラグインから下記のように見えていたものです。

bde-new-cluster-12.png

 

BDE にリソースとして登録した、データストアや、ポートグループなどを

表示することもできます。

serengeti>datastore list

  NAME              TYPE    REG EX

  --------------------------------

  defaultDSLocal    LOCAL   FALSE

  ds_nfs_hadoop_01  SHARED  FALSE

 

serengeti>network list

  NAME            PORTGROUP       TYPE  IP_RANGES  DNS1  DNS2  GATEWAY  MASK

  --------------------------------------------------------------------------

  defaultNetwork  pg-vlan-0005    dhcp

  bde-vlan-0005   dvpg-vlan-0005  dhcp

 

クラスタに接続して操作することもできます。

ためしに、BDE で構築した hdp_cluster01 というクラスタの HDFS 領域を参照してみます。

serengeti>cluster target --name hdp_cluster01

serengeti>cfg info

Hadoop [1.2.1 rev.1503152][fs=hdfs://192.168.5.128:8020][jt=192.168.5.125:8021]

serengeti>fs ls /tmp

Found 3 items

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:14 /tmp/hadoop-mapred

drwxrwxrwx   - hdfs hadoop          0 2014-09-17 23:13 /tmp/hadoop-yarn

drwxrwxrwx   - root hadoop          0 2014-09-21 23:38 /tmp/test

serengeti>fs ls /tmp/test

Found 2 items

drwxrwxrwx   - root hadoop          0 2014-09-21 23:37 /tmp/test/input

drwxrwxrwx   - root hadoop          0 2014-09-21 23:39 /tmp/test/output

 

serengeti CLI のヘルプは、下記のような感じです。

serengeti>help

* ! - Allows execution of operating system (OS) commands

* // - Inline comment markers (start of line only)

* ; - Inline comment markers (start of line only)

* cfg fs - Sets the Hadoop namenode - can be 'local' or <namenode:port>

* cfg info - Returns basic info about the Hadoop configuration

* cfg jt - Sets the Hadoop job tracker - can be 'local' or <jobtracker:port>

* cfg load - Loads the Hadoop configuration from the given resource

* cfg props get - Returns the value of the given Hadoop property

* cfg props list - Returns (all) the Hadoop properties

* cfg props set - Sets the value for the given Hadoop property - <name=value>

* clear - Clears the console

* cls - Clears the console

* cluster config - Config an existing cluster

* cluster create - Create a hadoop cluster

* cluster delete - Delete a cluster

* cluster export - Export cluster specification

* cluster fix - Fix a cluster failure

* cluster list - Get cluster information

* cluster resetParam - reset cluster parameters

* cluster resize - Resize a cluster

* cluster setParam - set cluster parameters

* cluster start - Start a cluster

* cluster stop - Stop a cluster

* cluster target - Set or query target cluster to run commands

* cluster upgrade - Upgrade an old cluster

* connect - Connect a serengeti server

* datastore add - Add new datastore(s)

* datastore delete - Delete an unused datastore

* datastore list - Display datastore list.

* date - Displays the local date and time

* disconnect - Disconnect a serengeti server

* distro list - Get distro information

* exit - Exits the shell

* fs cat - Copy source paths to stdout

* fs chgrp - Change group association of files

* fs chmod - Change the permissions of files

* fs chown - Change the owner of files

* fs copyFromLocal - Copy single src, or multiple srcs from local file system to the destination file system. Same as put

* fs copyMergeToLocal - Takes a source directory and a destination file as input and concatenates files in src into the destination local file

* fs copyToLocal - Copy files to the local file system. Same as get

* fs count - Count the number of directories, files, bytes, quota, and remaining quota

* fs cp - Copy files from source to destination. This command allows multiple sources as well in which case the destination must be a directory

* fs du - Displays sizes of files and directories contained in the given directory or the length of a file in case its just a file

* fs expunge - Empty the trash

* fs get - Copy files to the local file system

* fs ls - List files in the directory

* fs mkdir - Create a new directory

* fs moveFromLocal - Similar to put command, except that the source localsrc is deleted after it's copied

* fs mv - Move source files to destination in the HDFS

* fs put - Copy single src, or multiple srcs from local file system to the destination file system

* fs rm - Remove files in the HDFS

* fs setrep - Change the replication factor of a file

* fs tail - Display last kilobyte of the file to stdout

* fs text - Take a source file and output the file in text format

* fs touchz - Create a file of zero length

* help - List all commands usage

* hive cfg - Configures Hive

* hive script - Executes a Hive script

* loggedConnect - Connect a serengeti server with username/password as options and get logged into cli history

* mr jar - Run Map Reduce job in the jar

* mr job counter - Print the counter value of the MR job

* mr job events - Print the events' detail received by jobtracker for the given range

* mr job history - Print job details, failed and killed job details

* mr job kill - Kill the Map Reduce job

* mr job list - List the Map Reduce jobs

* mr job set priority - Change the priority of the job

* mr job status - Query Map Reduce job status.

* mr job submit - Submit a Map Reduce job defined in the job file

* mr task fail - Fail the Map Reduce task

* mr task kill - Kill the Map Reduce task

* network add - Add a network to Serengeti

* network delete - Delete a network from Serengeti by name

* network list - Get network information from Serengeti

* network modify - Modify a network from Serengeti by name

* pig cfg - Configures Pig

* pig script - Executes a Pig script

* quit - Exits the shell

* resourcepool add - Add a new resource pool

* resourcepool delete - Delete an unused resource pool

* resourcepool list - Get resource pool information

* script - Parses the specified resource file and executes its commands

* system properties - Shows the shell's properties

* topology list - List a rack-->hosts mapping topology

* topology upload - Upload a rack-->hosts mapping topology file

* version - Displays shell version

 

Web Client よりも細かい設定をする場合は、

この serengeti CLI を使用します。

 

マニュアルもあります。英語ですが・・・

VMware vSphere Big Data Extensions

Command-Line Interface Guide

vSphere Big Data Extensions 2.0

http://pubs.vmware.com/bde-2/topic/com.vmware.ICbase/PDF/vsphere-big-data-extensions-20-command-line-guide.pdf

 

以上、BDE のコマンドラインツールの話でした。

Viewing all 3135 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>