About

Work Experience

• Technical Staff Software Engineer, Dell Technologies

  Oct, 2019 - Present

  As my role of Architect confers responsibilities across the entire ZeroTouch platform (from Frontend design, through backend services, and the DevOps practices required to deploy them all), the last three years have included a wide range of accomplishments.

  • Architected, developed, and maintained a complex set of microservices in Python. This provided a singular source of truth for infrastructure builds, as well as providing real-time build statuses.

  • Automated hardware discovery, adoption, provisioning, and validation of physical hardware using event driven processes.

  • Developed interactive web UIs to demonstrate and facilitate use of previously developed micro-service backends.

  • Completed requirements and design for a prospective serverless functions platform, then performed and completed the industry search for the correct solution. Later, deployed that solution to Kubernetes, and performed team-wide training and coordination required to bring the service to production.

  • Develop Ansible roles for deploying and configuring applications into Kubernetes environments.

  • Developed Argo Workflows to perform condition based hardware, cabling, and data verification.

  • Started an Dell Python Developer Community with weekly meetings to cover topics such as development best practices, CICD pipelines, deployment platforms, and cross-team collaboration.

• Site Reliability Engineer, Dell Technologies

  Apr, 2014 - Oct, 20195 years 6 months

  As a build focused SRE, I was responsible for automating large scale deployment of storage servers in isolated colocation facilities. This required the design of a small footprint, easily deployable, and reproducible management stack that could support building out the rest of the environment. This supported not just the hardware provisioning, but supporting other platform teams that needed a stable foundation on which to stand up and run their automation.

  • Develop solution to support builds generally isolated from internal network and public Internet (firewalled colocation) using an initial bootstrap server, fully configured with Ansible, to provide services such as DNS, NTP, Proxy, and DHCP.

  • To facilitate local-only builds, built a StackStorm pack that assembles a manifest for each device in the build and keeps it updated as data is changed. This added a high level of reliability to our builds.

  • Built StackStorm actions that combine device manifest and templates to generate a 'Server Configuration Profile', which is applied to the iDRAC, setting static ip, authentication, dns, interface options, and the correct boot order.

  • Developed cable validation tooling to bring up links, parse LLDP, and log on matches, mismatches, or missing links.

  • Developed a build watcher tool to track expected devices and their current state in the build process. This data was exported into monitoring as OpenMetric data, with urgent issues being sent to slack or potentially as a page.

  • Wrote tools to issue LetsEncrypt certificates using DNS validation for limited access devices (iDRAC, PDUs, VM appliances) and to automatically install them.

  • Developed custom applications (Django and Flask based), along with DHCP and TFTP to automatically remotely boot, identify, test hardware, and install operating systems on servers during multi-site buildout projects.

  • Converted manual step vendor documentation into orchestrated processes for standing up EMC Atmos object storage clusters. This involves steps like cleaning drives, ensuring only the primary node in a cluster is powered on, powering on secondary nodes one at a time until each node has joined the cluster in the desired order.

  • In order to speed up OS install, built CPIO disk images or integrated kickstart/pre-seed templates for automated OS installation of EMC Atmos, EMC ECS, SLES, RedHat, Ubuntu, and VMWare operating systems.

• Global Resolutions Site Reliability Engineer, Verisign

  Jun, 2013 - Apr, 201410 months

  Operating two DNS root servers and hosting the dot com TLD, my team was constantly rebuilding individual datacenter locations throughout the year. These were complete tear down of existing hardware and a ground up install of the current year's footprint. I worked on developing Puppet modules to automate the redeployment of applications, building out a custom backend infrastructure inventory system, and build monitoring framework.

  • Developed Vagrant environments emulating production environment for deployment testing.

  • Work with hieradata to separate site or host specific data from logic.

  • Developed a system to automatically bootstrap new puppet masters on demand.

  • Build highly available content distribution sites by integrating DevOps technologies including Cobbler, Jenkins, Puppet, and YAML.

  • Document software and hardware configurations in flat, version controlled yaml format and build systems to generate configurations from the same.

  • Develop modules in Python/Django for an internal device management system, specifically data export APIs for integration with other systems.

  • Actively upgrading monitoring applications and configuration, including Nagios and NRPE checks, global messaging bus, and internal HUD (Heads Up Display).

  • Migrated monitoring systems from hand provisioned design to fully automated package and puppet based installation.

  • Advise development team on building Puppet modules and associated hieradata to work within the existing production environment.

  • Addressed numerous inconsistencies with infrastructure data (such as package repository and cobbler profiles) to ensure consistent build and installation experience across the entire infrastructure.

  • Working with multiple teams to replace colocated EOL multi-server hardware with an appliance-like, single server virtualized platform.

• DevOps Engineer, Penn State University Outreach

  Feb, 2013 - Jun, 20134 months

  I operated as a consultant to transition infrastructure management to the use of Puppet based configuration management. My accomplishments involved capturing a lot of the existing configuration into Puppet inventories, developing manifests to deploy or remediate applications, and Jenkins jobs to automatically implement changes.

  • Developed and documented workflows for standing up new services.

  • Documented existing environmental layouts for all teams.

  • Developed puppet modules to facilitate customer requirements.

  • Developed Jenkins jobs to automatically manage, test, and deploy code and applications

  • Provision and automatically deploy multi-server, multi-datacenter solutions for clients.

• Senior Linux Engineer, NTT America

  Apr, 2011 - Feb, 20131 year 10 months

  Performed solution delivery and Linux/Solaris system administration for a co-location/dedicated Fortune 500 company. Responsible for maintaining and coordinating maintenance in multiple data-centers.

  • Designed and implemented Puppet environments for both internal and customer application stacks.

  • Install and configures software requested by customers.

  • Migration of large, international clients from physical to virtual (VMWare) cloud environment.

  • Maintenance and provisioning of customer's virtual environment.

  • Documentation and training of junior administrators on new platforms.

  • Works with management to develop and refine division wide processes, procedures, and technical documentation.

  • Coordinate technical tasks to be completed by/with other groups.

• Team Lead/L3 Linux Administrator, NTT America

  Jun, 2007 - Apr, 20113 years 10 months

  Performed solution delivery and Linux/Solaris system administration for a co-location/dedicated Fortune 500 company. Responsible for maintaining and coordinating maintenance in multiple data-centers.

  • Acts in a supervisory capacity for shift, overseeing workload distribution, quality, and timely escalations.

  • Monitors customer and internal systems and responds to generated alerts.

  • Installed, configured, and troubleshooted Veritas Netbackup clients.

  • Utilized a wide array of knowledge to troubleshoot customer's websites: (coding, dns, apache, network configuration).

  • Administered systems with RHEL versions 3-6; Solaris 8,9, and 10; VMware ESX and VI4.

  • Performed hardware troubleshooting tasks, delegating repair tasks to data center technicians.

  • Assisted data center technicians with provisioning and configuration tasks.

• Owner/Operator, YourTech, LLC

  Jan, 2001 - Oct, 201211 years 9 months

  Operated an independent computer service business for over five years providing network, server, and workstation support to business clients in wide array of business environments. Additionally, maintained business' network, including Linux and Windows servers, workstations, and firewall

  • Implemented several monitoring systems for customers network and devices.

  • Developed a virtualized application server environment with automated backup and failover capabilities for a 10-person office that previously had no dedicated server.

  • Actively administered separate Linux and BSD Unix servers providing email, web hosting, Radius, and DNS services to approximately 300 end-users on an ongoing basis. Additionally implementing upgrades and repairs as needed.

  • Converted and maintained a small office from a failing Windows 2000 server to a Linux based file storage system.

  • Developed and maintained a campground wide network including access points and a customized firewall solution.

  • Engineered and deployed a robust, scalable backbone system for two separate wireless ISPs in rural, mountainous terrain.

• Linux Systems Administrator and Developer, The PCMD, Inc

  Oct, 2004 - Apr, 20031 year 5 months

  Was hired on to design, implement, and maintain all services and software needed to create a reliable dial-up Internet service.

  • Designed and configured RADIUS authentication server using SQL back-end, additionally configuring system to work properly with outside vendor's radius requirements.

  • Created a high availability mail server using external Dell Power Vault RAID 5 storage, hot-swappable servers, and BSD Unix jails.

  • Configured and maintained primary and secondary email servers using Qmail and a MySQL backend.

  • Developed shell scripts to simply common Linux administration tasks, as well as automating recurring maintenance activities.

  • Configured and maintained Apache web servers for virtual hosting customers as well as internal support web sites.

  • Developed a complete accounting and customer support system in PHP, Perl, and SQL allowing administrators, resellers, and customers to manage their accounts through a web interface. System handled all aspects of customer accounts, including customer sign-up, server provisioning, credit card authorizations, automated invoicing, and reseller commissions.

• Linux Systems Administrator and Developer, Allegheny Intel, LLC

  Apr, 2003 - Jan, 20003 years 2 months

  Duties included installing, hardening, and administrating RADIUS authentication servers, mail servers, LDAP databases, web servers, FTP servers, and SQL databases all on a variety of Linux based operating systems. Developed numerous scripts and utilities to assist in billing, system administration, and system security. Configured, purchased, and installed Dell Power Edge servers and workstations.

  • Supervised, interviewed, hired, and trained customer support technicians, growing the original five member team to over 20 technicians over a period of two years. Additionally handled scheduling, performance reviews, disciplinary actions, termination, starting wages, and wage increases on a regular basis.

  • As the technical support team grew, selected and trained lead technicians and support supervisors.

  • Configured and maintained Apache web servers for virtual web hosting customers and Allegheny Intel's primary web site.

  • Developed a customer support web application in SQL and Perl for the technical support and accounting departments. This application became a core business component, used for tracking every interaction with the customer including sign-up, trouble tickets, payments, transactions, and requests.

  • Configured a Linux based LDAP directory of over 40,000 users and implemented a system to authenticate users against this directory through the RADIUS protocol.

  • Configured and maintained primary and secondary email servers using Postfix with an LDAP backend.

  • Configured supplement Sendmail based mail servers to process internal email before sending to our upstream Postfix based server.

  • Developed shell scripts to simply common Linux administration tasks, as well as automating recurring maintenance activities.

  • Deployment of a fault tolerance solution for the mail system involving a detached RAID 5 disk array and an automatic migration to a hot-spare server saving hours of downtime over a period of several years

  • Configured a web-based graphical network and local server monitoring system based on the SNMP protocol and the MRTG project.

  • Configured, maintained and troubleshooted a Trip Wire Intrusion Detection System, establishing the server system and deploying clients to monitor for any possible intrusions or abnormal system behavior.

  • Configured and maintained Cisco 7600 and 2600 routers, AS5400 and 5300 access servers.

  • Configured and maintained a centralized backup server utilizing an external Dell Tape drive.

• Embarkation Chief and Training NCO, United States Marine Corps

  Jun, 2006 - Dec, 19996 years 5 months

  My time in the Marines trained me to be confident, disciplined, teamwork, and the drive to overcome obstacles in order to accomplish an objective.

  • Worked with high level personnel to develop training schedules in order to meet annual training requirements. Additionally, responsible for ensuring that the training needs of the individual Marines in our unit had been met.

  • Developed and maintained current embarkation plans for unit, including inventory information, transportation logistics, as well as shipping and packing procedures. Provided embarkation, logistical, and disembarkation support for multiple overseas deployments.

  • During a seven month period, operated and maintained an Internet communications center in Fallujah, Iraq under extreme conditions.

Education

Volunteer Work