...

1. Purge old DB-records
   1. cinder-manage db purge 0
2. Add the following three lines to the node-file of the first node you would like to upgrade:

   1. apache::service_ensure: 'stopped'

   2. cinder::scheduler::enabled: false

   3. cinder::volume::enabled: false

3. Run puppet on the first host with ussuri modules/tags
4. Run apt-get autoremove && apt-get dist-upgrade
5. Run puppet again
6. Run cinder-manage db sync && cinder-manage db online_data_migrations
7. Remove the lines added at step 1, re-run puppet, and test that the upgraded cinder version works.
8. Perfom step 2-5 for the rest of the cinder nodes

Neutron

API-nodes

1. Pick the first node, and run puppet with the ussuri modules/tags
2. Run apt-get autoremove && apt-get dist-upgrade

3. Run neutron-db-manage upgrade --expand
4. Run neutron-db-manage --subproject neutron-fwaas upgrade head
5. Restart neutron-server.service and rerun puppet
6. Upgrade the rest of the API-nodes (repeating step 1, 2, 5)
7. Stop all neutron-server processes for a moment, and run:
   
   1. neutron-db-manage upgrade --contract
8. Re-start the neutron-server processes

BGP-agents

1. Run puppet with the ussuri modules/tags
2. Run apt dist-upgrade
3. Rerun puppet and restart the service
   1. systemctl restart neutron-bgp-dragent.service


Network-nodes

1. Run puppet with the ussuri modules/tags
2. Run apt dist-upgrade
3. Rerun puppet and restart the service
   1. systemctl restart ovsdb-server
   2. systemctl restart neutron-dhcp-agent.service neutron-l3-agent.service neutron-metadata-agent.service neutron-openvswitch-agent.service neutron-ovs-cleanup.service