NSX Series on all Major Functions

Aside August 31, 2016September 30, 2016Pradeep AdapaLeave a comment

I have struggled to understand the concepts of VMware NSX major functionality like NSX Edge Services Gateway, Edge Distributed Logical Router and their options, hence I am writing this series to explain in detail what I have learnt in the past few days regarding these functions in layman terms and not the marketing jargon I see on the internet regarding VMware NSX.

Part 1 — NSX Edge Services Gateway

Edge services Gateway has many functions such as L2 Gateway service, L2 Bridging between virtual to physical networks, DHCP, NAT etc.

It is very easy to create Logical switches in the NSX option using vCenter server web client

The hard part comes when you have multiple networks (with subnets) you want to activate on the edge services gateway so that they communicate to each other and to the external uplink on the edge services gateway.

Here is how I did it,

First, I created two Logical switches

App-LG
Web-LG

I have an L2 physical network switch for my home lab, so I am sure I can’t do L3 routing, in this instance I am going to show you how to create an Edge Services gateway with the proper interfaces to have multiple subnets communicating between them on a VM connected to one of these logical switches.

First, we deploy an Edge services gateway using the default options and the interfaces as shown below:

Here are the interfaces which I have configured on the gateway

In the above picture, I created one vNIC as an Uplink (I named it as External) and the IP address I gave that interface as 192.168.0.79/24 (192.168.0.0/24) is my LAN subnet in my home

Then I created two Internal interfaces (I named one as Internal) with interface IP addresses as 172.168.10.2/24 and 172.168.11.2/24 where the IP addresses 172.168.10.2 and 172.168.11.2 act as IP default gateways to the VMs attached to logical gateways App-LG and Web-LG which are connected to the two internal interfaces

Also, I configured the Default gateway in the Edge Services Gateway configuration while deploying as shown:

Now, that we have configured the L2 logical networks on the Edge Services Gateway with the interfaces, let us go to the VMs and see how the communication goes on through the logical networks

We have a test VM called Win7 connected to App-LG (which has an interface IP address as 172.168.10.2) hence the default gateway of this VM will be 172.168.10.2

Here we see the communication using ping to all the interfaces ip addresses both internal and external

In the above picture, you can see that we are able to ping the three interfaces (192.168.0.79, 172.168.10.2 and 172.168.11.2) even though the VM gateway is 172.168.10.2 since its logical gateway is App-LG.

Also, note that we weren’t able to ping my default gateway 192.168.0.1 since there is no interface or routing to 192.168.0.1 in the edge services gateway. We will cover this under routing and NSX Distributed Logical Router part next.

By this, I am concluding this part as I wanted to show you how logical networks can be used with VMS and how their networks can route between the different subnets using Edge services gateway. This is for the East-West traffic between VMS.

Nutanix on UCS C-Series Rack Servers

August 21, 2016August 21, 2016Pradeep Adapa1 Comment

As of 8/18/2016 Nutanix (as far as I know), Nutanix started selling its platform (Acropolis Hypervisor and Prism Software) on Cisco UCS C-series servers. Nutanix now supports the following UCS servers —

C220-M4S
C240-M4L
C240-M4SX

Looks like the Nutanix Software bundle comes in Acropolis Pro and Ultimate Editions.

More info to follow ….

Reference: Nutanix Website

Disable vSphere Managed Object Browser (MOB)

August 18, 2016Pradeep AdapaLeave a comment

To harden your ESXi 6.0 hosts, we disable the MOB service so that any attacker can’t get to the web browser and access the MOB of the ESXi host (ex: https://esxi01.lab.com/mob), this setting will disable one of the attack vectors of theESXi hosts in the environment.

to do this, you SSH into the ESXi host where you want to disable the mob service and perform the following commands

esxi01# vim-cmd proxysvc/remove_service "/mob" "httpsWithRedirect"

to verify if the mob service has been removed from the ESXi host, use the following command

esxi01# vim-cmd proxysvc/service_list

the above command will list all the services on the ESXi host, look for the service “/mob”, if you don’t see this service, then it has been removed. if it is still there, then you will have to perform the first command and reboot the ESXi host to disable the mob service from the host.

Shutdown multiple ports on MDS 9148 and 9396

August 16, 2016Pradeep AdapaLeave a comment

Recently, I had to shutdown multiple ports on a Cisco MDS 9396 switch for maintenance. I had to look up the commands to do it as I haven’t done it yet as most of the customers will either shut down the switch completely or just shutdown the required ports and not multiple ports on the switch.

here are the commands to shutdown all ports on the switch at once:

MDS1# conf t

MDS1(config)# int fc1/1-40

MDS1(config-if)#shutdown

If you have to shutdown the ports and they are not in sequence, here is the command

MDS1# conf t

MDS1(config)# int fc1/1-5,fc1/7-15

MDS1(config-if)# shutdown

Hope these above commands help !!

Can’t fork error on ESi 6 host on UCS Blade

August 14, 2016March 2, 2017Pradeep AdapaLeave a comment

Recently, I was working on an UCS blade firmware upgrade along with esxi upgrade from esxi 5.5 to 6.0 and came across this error where the esxi host became unresponsive with an error “can’t fork” on its DCUI.

here is a little background on this story, this particular blade was B240 blade which was being used as SAP HANA blade by the customer and the firmware upgrade and esxi upgrade went fine and two days later the host became unresponsive and we couldn’t connect to it using SSH, DCUI, etc, connecting to the kvm console revealed the below screen when we went to its Alt+F1 command interface

Esxi_Cant_fork_error

we had to bounce the box and we had to reduce the linux vm memory which was hosting SAP HANA on it to be 10% less than the memory of the esxi host.

Conclusion: The HANA VM (linux) on the esxi host should have 10% less memory than the overall memory of the esxi host to avoid this problem.

How to Install Cisco VEM vib on an ESXi 6 host

August 14, 2016March 2, 2017Pradeep AdapaLeave a comment

Recently, I had to install the Cisco vem module onto an esxi 6 host as it was not installed and i couldn’t join the esxi host to the cisco nexus 1000v distributed switch. here is the process on how to first check if the vem module is installed on the esxi host.

SSH into the esxi host and run the following commands to check if the VEM module is installed

host# esxcli software vib list | grep -i vem

the above command will display the cisco vem module installed on the esxi host, if nothing is displayed then you will have to install the vem module by downloading the vem vib from the nexus 1kv in the environment.

i did it by going to https://nexus1kv_hostname in a web browser which will display you the vibs which you can download from nexus 1000v, download the vem vib associated with your environment and run the following command to install the vib onto the esxi host

upload the vem vib file onto a datastore on the host

SSH into the esxi host where you want to install the vem module

host# esxcli software vib install -v /vmfs/volumes/<directory_path>/cross_cisco-vem-version_x.x.x.x.x.vib

NOTE: directory_path in the above command is the place where the cisco vem vib is stored. (name of the datastore/volume)

Once the vib is installed you can check the status of the vem by using the command

host# vem status

The above command will display that the VEM agent (vemdpa) is running

Restart the services in VCSA 6.0

August 12, 2016August 16, 2016Pradeep Adapa2 Comments

Recently I had to restart the web-client service in vcsa 6.0 U1 appliance and found out that the web client service is called differently than in the windows vCenter. the web client service in the vcsa is called vSphere-client

here are the commands to start, stop and restart any services in the vcsa appliance.

To restart a vCenter Server and/or Platform Services Controller service using the command-line:
Log in as root through an SSH or console session on the vCenter Server Appliance.
Run this command to enable the shell:

shell.set --enabled true

Run this command to launch the shell:

shell

Run this command to change directories to /bin:

cd /bin

Run this command to list the vCenter Server Appliance services:

service-control --list

Run this command to stop a specific service:

service-control --stop servicename

You may also stop all services by typing the command:

service-control --stop --all

Run this command to start a specific service:

service-control --start servicename

You may also start all services by typing the command:

service-control --start --all

Here are all the services in the vCenter server appliance –>

vCenter Server Appliance services:

Service Name	Description
applmgmt	VMware Appliance Management Service
vmware-cis-license	VMware License Service
vmware-cm	VMware Component Manager
vmware-eam	VMware ESX Agent Manager
vmware-sts-idmd	VMware Identity Management Service
vmware-invsvc	VMware Inventory Service
vmware-mbcs	VMware Message Bus Configuration Service
vmware-netdumper	VMware vSphere ESXi Dump Collector
vmware-perfcharts	VMware Performance Charts
vmware-rbd-watchdog	VMware vSphere Auto Deploy Waiter
vmware-rhttpproxy	VMware HTTP Reverse Proxy
vmware-sca	VMware Service Control Agent
vmware-sps	VMware vSphere Profile-Driven Storage Service
vmware-stsd	VMware Security Token Service
vmware-syslog	VMware Common Logging Service
vmware-syslog-health	VMware Syslog Health Service
vmware-vapi-endpoint	VMware vAPI Endpoint
vmware-vdcs	VMware Content Library Service
vmafdd	VMware Authentication Framework
vmcad	VMware Certificate Service
vmdird	VMware Directory Service
vmware-vpostgres	VMware Postgres
vmware-vpx-workflow	VMware vCenter Workflow Manager
vmware-vpxd	VMware vCenter Server
vmware-vsm	VMware vService Manager
vsphere-client	vSphere Web Client
vmware-vws	VMware System and Hardware Health Manager
vmware-vsan-health	VMware Virtual SAN Health Service

Reference: VMware_KB_Article

How-to Upgrade Cisco Nexus 1000v

August 3, 2016August 3, 2016Pradeep AdapaLeave a comment

Here is a great article on how to upgrade Cisco Nexus 1000v in the virtual environment,

Upgrade Cisco Nexus 1000v Firmware

This is a really good post by Mark Strong.

The only thing I would replace in the article are useing tftp server instead of using scp to the nexus 1000v vsm using putty in Step 4 of the article.